2024-08-17T02:14:37.861 INFO:root:teuthology version: 1.2.0 2024-08-17T02:14:37.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:14:38.009 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858283' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhwVYS96B2JdJgt/w7jUZAWCzKQt9CZ8t+ZyaVvRQjNJIrH7nqVev1zYiYztx+uLF9sO33EARzwXc1kKj5pcGE= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzoQQmv0eJPLOt7M2sTzixbH3S5rfSFR5vXhXJ9fpYznEttbSa7pqm7pHf9PgKoIKB/DyZnbncO4CgaiMGcoBY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:14:38.010 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:14:38.010 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:14:38.011 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:14:38.012 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:14:38.033 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:14:38.033 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:14:38.033 INFO:teuthology.packaging:ref: None 2024-08-17T02:14:38.033 INFO:teuthology.packaging:tag: None 2024-08-17T02:14:38.033 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:38.033 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:14:38.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:14:38.180 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:14:38.182 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:14:38.188 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:14:38.188 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:14:38.194 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:14:38.210 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:14:38.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:14:38.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:07:41.774524', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhwVYS96B2JdJgt/w7jUZAWCzKQt9CZ8t+ZyaVvRQjNJIrH7nqVev1zYiYztx+uLF9sO33EARzwXc1kKj5pcGE='} 2024-08-17T02:14:38.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:07:41.776053', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzoQQmv0eJPLOt7M2sTzixbH3S5rfSFR5vXhXJ9fpYznEttbSa7pqm7pHf9PgKoIKB/DyZnbncO4CgaiMGcoBY='} 2024-08-17T02:14:38.263 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:14:38.269 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:14:38.269 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:14:38.269 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:14:38.322 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1ceb1e3ac0>, signals=[15]) 2024-08-17T02:14:38.322 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:14:38.328 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:14:38.329 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:14:38.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.460 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:14:38.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:14:38.547 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:14:38.552 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-08-17T02:14:38.571 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-08-17T02:14:38.571 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-08-17T02:14:38.629 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-08-17T02:14:38.629 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-08-17T02:14:38.629 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-08-17T02:14:38.629 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:14:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:14:38.631 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-08-17T02:14:38.649 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-08-17T02:14:38.666 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-08-17T02:14:38.667 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:14:38.723 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:14:38.724 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:14:38.724 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:14:38.724 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-08-17T02:14:38.740 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:14:38.753 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:14:38.759 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:14:38.759 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:38.762 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:14:38.779 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:14:38.785 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:14:38.785 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:38.819 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:14:38.955 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:14:39.008 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:14:39.031 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:14:39.031 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:14:39.032 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:14:39.032 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:39.032 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:14:39.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:39.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:14:39.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:14:39.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:14:39.211 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:39.211 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:14:39.211 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-08-17T02:14:39.212 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:39.212 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:14:39.213 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-08-17T02:14:39.229 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:14:39.229 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:39.229 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:14:39.230 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum upgrade -y linux-firmware 2024-08-17T02:14:39.231 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:14:39.231 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:39.231 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:14:39.231 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum upgrade -y linux-firmware 2024-08-17T02:14:41.567 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:14:41.598 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:14:43.609 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:14:44.282 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-08-17T02:14:48.610 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.6 MB 00:01 2024-08-17T02:14:48.849 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.6 MB 00:00 2024-08-17T02:14:50.268 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-17T02:14:51.106 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-17T02:14:51.392 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 18 kB 00:01 2024-08-17T02:14:52.312 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-17T02:14:56.461 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-17T02:14:57.910 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:14:58.507 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 1 Package 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:14:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 383 M 2024-08-17T02:14:58.515 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-08-17T02:15:00.038 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-08-17T02:15:00.048 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 1 Package 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 383 M 2024-08-17T02:15:00.049 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-08-17T02:15:04.545 INFO:teuthology.orchestra.run.smithi162.stdout:linux-firmware-20240716-145.el9.noarch.rpm 64 MB/s | 383 MB 00:05 2024-08-17T02:15:04.545 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:15:04.545 INFO:teuthology.orchestra.run.smithi162.stdout:Total 64 MB/s | 383 MB 00:06 2024-08-17T02:15:05.203 INFO:teuthology.orchestra.run.smithi046.stdout:linux-firmware-20240716-145.el9.noarch.rpm 75 MB/s | 383 MB 00:05 2024-08-17T02:15:05.203 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:15:05.203 INFO:teuthology.orchestra.run.smithi046.stdout:Total 74 MB/s | 383 MB 00:05 2024-08-17T02:15:07.613 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-08-17T02:15:07.701 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-08-17T02:15:07.702 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-08-17T02:15:08.435 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-08-17T02:15:08.532 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-08-17T02:15:08.532 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-08-17T02:15:11.037 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-08-17T02:15:11.037 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-08-17T02:15:11.948 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-08-17T02:15:11.949 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-08-17T02:15:20.233 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-08-17T02:15:20.918 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:21.009 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:21.285 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-08-17T02:15:21.889 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:21.890 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:21.972 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:22.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:22.584 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:15:22.585 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-08-17T02:15:22.585 INFO:teuthology.orchestra.run.smithi162.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:15:22.585 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:15:22.585 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-08-17T02:15:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:22.865 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:15:22.944 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:22.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:15:23.122 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:15:23.122 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:15:23.125 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi162.front.sepia.ceph.com to complete... 2024-08-17T02:15:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:15:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:15:23.605 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-08-17T02:15:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:15:23.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:15:23.606 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-08-17T02:15:23.922 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:15:23.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:15:24.068 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:15:24.068 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:15:24.070 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi046.front.sepia.ceph.com to complete... 2024-08-17T02:15:55.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17 02:15:55 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:FINISHED --2024-08-17 02:15:55-- 2024-08-17T02:15:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:Total wall clock time: 32s 2024-08-17T02:15:55.746 INFO:teuthology.orchestra.run.smithi046.stderr:Downloaded: 1 files, 344M in 31s (11.0 MB/s) 2024-08-17T02:15:55.751 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:15:55.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:55.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17 02:15:55 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:55.918 INFO:teuthology.orchestra.run.smithi162.stderr:FINISHED --2024-08-17 02:15:55-- 2024-08-17T02:15:55.918 INFO:teuthology.orchestra.run.smithi162.stderr:Total wall clock time: 33s 2024-08-17T02:15:55.918 INFO:teuthology.orchestra.run.smithi162.stderr:Downloaded: 1 files, 344M in 32s (10.7 MB/s) 2024-08-17T02:15:55.922 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:55.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:57.921 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying... ######################################## 2024-08-17T02:15:57.967 INFO:teuthology.orchestra.run.smithi046.stdout:Preparing... ######################################## 2024-08-17T02:15:57.987 INFO:teuthology.orchestra.run.smithi162.stdout:Verifying... ######################################## 2024-08-17T02:15:58.021 INFO:teuthology.orchestra.run.smithi046.stdout:Updating / installing... 2024-08-17T02:15:58.723 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing... ######################################## 2024-08-17T02:15:58.774 INFO:teuthology.orchestra.run.smithi162.stdout:Updating / installing... 2024-08-17T02:16:06.374 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:16:06.733 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:16:44.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:44.596 DEBUG:teuthology.orchestra.run.smithi046:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:44.686 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.686 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.686 INFO:teuthology.orchestra.run.smithi046.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:44.687 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:44.688 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:44.689 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:44.690 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:44.691 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:44.692 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:44.693 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:44.694 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:44.695 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:44.696 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:44.697 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:44.698 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:44.699 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:44.700 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:44.701 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:44.702 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:44.703 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:44.704 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:44.705 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:44.706 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:44.707 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:44.708 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:44.709 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:44.710 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:44.711 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:44.712 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:44.713 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:44.714 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:44.715 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:44.716 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:44.717 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:44.718 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:44.719 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:44.720 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:44.721 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:44.722 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:44.723 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:44.726 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:44.727 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:44.728 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:44.729 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:44.730 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:44.731 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:44.732 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:44.733 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:44.734 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:44.735 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:44.736 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:44.737 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:44.738 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:44.739 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:44.740 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:44.741 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:44.742 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:44.743 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:44.744 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:44.745 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:44.746 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:44.747 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:44.748 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:44.749 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:44.750 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:44.751 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:44.752 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:44.753 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:44.754 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:44.755 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:44.756 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:44.757 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:44.758 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:44.759 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:44.760 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:44.761 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:44.762 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:44.763 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:44.764 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:44.765 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:44.766 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:44.767 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:44.768 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:44.769 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:44.770 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:44.771 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:44.772 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:44.773 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:44.774 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:44.775 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:44.776 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:44.778 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:44.779 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:44.780 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:44.781 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:44.782 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:44.783 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:44.784 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:44.785 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:44.786 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:44.787 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:44.789 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:44.790 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:44.791 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:44.792 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:44.793 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:44.794 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:44.795 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:44.796 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:44.797 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:44.798 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:44.799 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:44.800 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:44.801 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:44.804 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:44.805 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:44.806 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:44.807 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:44.809 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:44.810 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:44.811 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:44.812 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:44.813 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:44.814 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:44.815 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:44.816 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:44.817 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:44.819 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:44.820 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:44.821 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:44.822 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:44.823 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:44.824 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:44.825 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:44.827 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:44.828 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:44.829 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:44.830 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:44.831 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:44.832 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:44.833 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:44.834 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:44.835 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:44.836 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:44.837 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:44.838 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:44.839 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:44.840 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:44.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:44.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:44.841 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:44.842 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:44.843 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:44.845 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:44.846 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:44.847 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:44.848 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:44.849 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:44.850 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:44.851 INFO:teuthology.orchestra.run.smithi046.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:44.855 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.855 DEBUG:teuthology.orchestra.run.smithi046:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout: fi 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:done 2024-08-17T02:16:44.880 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.881 INFO:teuthology.orchestra.run.smithi046.stdout:fi 2024-08-17T02:16:44.882 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-08-17T02:16:44.942 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:44.943 DEBUG:teuthology.orchestra.run.smithi162:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:44.962 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:44.963 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-08-17T02:16:44.964 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:16:44.965 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:44.965 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:44.965 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:44.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:45.061 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.061 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.061 INFO:teuthology.orchestra.run.smithi162.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.061 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:45.062 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:45.063 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:45.064 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:45.066 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:45.066 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:45.066 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:45.067 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:45.068 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:45.069 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:45.070 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:45.071 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:45.071 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:45.071 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:45.072 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:45.072 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:45.072 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:45.072 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:45.073 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:45.074 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:45.075 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:45.076 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:45.077 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:45.078 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:45.079 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:45.080 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:45.081 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:45.082 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:45.083 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:45.084 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:45.085 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:45.086 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:45.087 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:45.089 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:45.091 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:45.092 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:45.093 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:45.094 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:45.095 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:45.096 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:45.097 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:45.098 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:45.099 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:45.100 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:45.101 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:45.102 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:45.103 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:45.104 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:45.105 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:45.106 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:45.107 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:45.108 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:45.109 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:45.110 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:45.113 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:45.114 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:45.115 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:45.117 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:45.118 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:45.119 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:45.120 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:45.121 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:45.122 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:45.122 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:45.122 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:45.122 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:45.122 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:45.123 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:45.124 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:45.125 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:45.126 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:45.127 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:45.128 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:45.129 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:45.130 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:45.131 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:45.132 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:45.133 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:45.134 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:45.135 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:45.136 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:45.137 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:45.138 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:45.141 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:45.142 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:45.143 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:45.144 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:45.145 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:45.146 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:45.147 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:45.148 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:45.149 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:45.150 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:45.151 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:45.152 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:45.153 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:45.154 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:45.155 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:45.156 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:45.157 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:45.158 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:45.159 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:45.160 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:45.161 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:45.162 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:45.163 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:45.164 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:45.165 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:45.166 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:45.167 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:45.168 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:45.169 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:45.170 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:45.171 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:45.172 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:45.173 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:45.174 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:45.175 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:45.176 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:45.177 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:45.178 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:45.179 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:45.181 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:45.183 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:45.184 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:45.185 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:45.186 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:45.187 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:45.188 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:45.189 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:45.190 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:45.191 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:45.192 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:45.193 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:45.194 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:45.195 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:45.198 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:45.199 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:45.201 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:45.202 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:45.203 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:45.204 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:45.205 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:45.206 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:45.207 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:45.208 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:45.209 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:45.210 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:45.211 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:45.212 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:45.213 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:45.214 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:45.216 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:45.217 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:45.218 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:45.219 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:45.220 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:45.221 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:45.222 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:45.223 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:45.224 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:45.225 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:45.226 INFO:teuthology.orchestra.run.smithi162.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:45.230 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.230 DEBUG:teuthology.orchestra.run.smithi162:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:45.253 INFO:teuthology.orchestra.run.smithi162.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:45.253 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:45.253 INFO:teuthology.orchestra.run.smithi162.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: fi 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:done 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:45.254 INFO:teuthology.orchestra.run.smithi162.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.255 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-17T02:16:45.255 INFO:teuthology.orchestra.run.smithi162.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:45.255 INFO:teuthology.orchestra.run.smithi162.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:45.255 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.255 INFO:teuthology.orchestra.run.smithi162.stdout:fi 2024-08-17T02:16:45.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 68.el9 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-08-17T02:16:45.328 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8264254 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-08-17T02:16:45.329 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:16:45.330 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:45.331 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:45.331 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:45.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:45.591 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-08-17T02:16:45.900 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-08-17T02:16:46.980 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:46.999 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-08-17T02:16:47.001 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-08-17T02:16:47.016 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.hAKl2s9so3 2024-08-17T02:16:47.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hAKl2s9so3 2024-08-17T02:16:47.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.hAKl2s9so3 2024-08-17T02:16:47.224 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.hAKl2s9so3 is 6KB 2024-08-17T02:16:47.272 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.hAKl2s9so3 2024-08-17T02:16:47.274 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:47.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:47.315 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-08-17T02:16:47.317 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-17T02:16:47.331 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.pSjVswkB2x 2024-08-17T02:16:47.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pSjVswkB2x 2024-08-17T02:16:47.350 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:47.350 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:47.350 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:47.350 INFO:teuthology.orchestra.run.smithi046.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:47.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:47.405 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.pSjVswkB2x 2024-08-17T02:16:47.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-08-17T02:16:47.547 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.pSjVswkB2x is 6KB 2024-08-17T02:16:47.595 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.pSjVswkB2x 2024-08-17T02:16:47.610 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:47.610 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-08-17T02:16:47.672 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:47.672 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:47.673 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:47.673 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:47.674 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:47.807 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-08-17T02:17:17.555 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:17:17.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:17:17.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:17.810 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:17:17.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:17:17.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:35.967 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-08-17T02:17:36.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-08-17T02:17:44.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:17:44.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:45.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:17:45.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:48.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-08-17T02:17:48.290 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-08-17T02:18:00.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:18:00.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:00.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:18:00.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:18.463 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-08-17T02:18:33.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:18:33.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:18:34.747 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-08-17T02:18:35.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:18:35.265 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:18:35.266 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-08-17T02:18:35.300 INFO:teuthology.orchestra.run.smithi046.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:35.302 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:35.302 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:18:35.302 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:18:36.305 DEBUG:teuthology.parallel:result is None 2024-08-17T02:19:00.295 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:19:15.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:19:15.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:15.607 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-08-17T02:19:16.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:19:16.071 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:19:16.072 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-08-17T02:19:16.106 INFO:teuthology.orchestra.run.smithi162.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:19:16.106 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:19:16.106 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:19:16.107 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:19:17.110 DEBUG:teuthology.parallel:result is None 2024-08-17T02:19:17.111 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:19:17.121 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:19:17.121 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:19:17.126 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:19:17.166 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:19:17.172 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:19:17.182 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:19:17.183 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:19:17.209 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:19:17.261 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:19:17.267 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:19:17.268 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:19:17.271 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:19:17.390 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:17.394 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:17.428 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:17.434 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:17.438 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:19:17.445 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:19:17.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:19:17.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:19:17.506 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:19:17.518 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:19:17.519 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:19:17.522 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:19:17.557 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:17.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:17.738 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:17.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:17.872 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:19:17.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:19:17.926 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:17.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:18.072 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:18.134 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:18.206 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:19:18.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:19:18.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-08-17T02:19:18.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-08-17T02:19:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:19:18.376 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:19:18.836 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:19:18.849 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:19:18.849 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:19:18.882 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:19:18.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-08-17T02:19:18.987 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-08-17T02:19:18.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-08-17T02:19:19.075 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-08-17T02:19:19.079 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:19:19.079 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-08-17T02:19:19.125 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-08-17T02:19:19.126 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-08-17T02:19:19.185 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-08-17T02:19:19.185 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:19:19.185 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:19:19.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:19:19.245 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:19:19.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:19:19.328 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:19:19.329 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:19:19.394 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:19:19.451 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:19:19.460 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:19:19.475 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:19:19.477 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:24:57.334 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-08-17T02:24:57.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:24:57.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:57.430 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-08-17T02:24:57.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-08-17T02:24:57.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:24:57.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:57.626 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-08-17T02:24:57.732 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-08-17T02:24:57.733 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:24:57.743 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:24:57.743 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:57.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:57.747 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:57.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:57.805 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:57.833 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:57.835 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:57.863 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:57.887 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-08-17T02:24:57.911 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-08-17T02:24:57.914 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-08-17T02:24:57.939 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-08-17T02:24:57.941 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:57.968 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:57.972 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:57.998 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:58.076 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:58.114 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:58.114 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-08-17T02:24:58.115 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.115 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.115 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.115 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:58.116 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:24:58.123 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:24:58.123 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:24:58.123 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:24:58.123 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:24:58.129 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:24:58.129 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:24:58.130 DEBUG:teuthology.orchestra.run.smithi046:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:58.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:58.827 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:01:21 ago on Sat 17 Aug 2024 02:23:37 AM UTC. 2024-08-17T02:24:58.854 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:15 ago on Sat 17 Aug 2024 02:23:43 AM UTC. 2024-08-17T02:24:58.914 INFO:teuthology.orchestra.run.smithi162.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:58.945 INFO:teuthology.orchestra.run.smithi046.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:58.957 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-08-17T02:24:58.958 INFO:teuthology.orchestra.run.smithi162.stdout:Nothing to do. 2024-08-17T02:24:58.958 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-08-17T02:24:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-08-17T02:24:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-08-17T02:24:58.992 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-08-17T02:24:59.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:59.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:, 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:59.281 INFO:teuthology.orchestra.run.smithi162.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:59.328 INFO:teuthology.orchestra.run.smithi046.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:59.328 INFO:teuthology.orchestra.run.smithi046.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:59.328 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-08-17T02:24:59.328 INFO:teuthology.orchestra.run.smithi046.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr:, 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:59.329 INFO:teuthology.orchestra.run.smithi046.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:59.362 INFO:teuthology.orchestra.run.smithi162.stdout:Repository successfully enabled. 2024-08-17T02:24:59.406 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:59.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:59.411 INFO:teuthology.orchestra.run.smithi046.stdout:Repository successfully enabled. 2024-08-17T02:24:59.456 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:59.456 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:59.554 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:59.555 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:59.597 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:59.598 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:59.669 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:59.670 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:24:59.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:59.713 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:59.713 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:24:59.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:59.726 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:59.726 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:59.771 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:59.771 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:59.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:59.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:59.902 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:59.948 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:59.958 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-08-17T02:24:59.961 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-08-17T02:25:00.004 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-08-17T02:25:00.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-08-17T02:25:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-08-17T02:25:00.267 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:25:00.289 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-08-17T02:25:00.323 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:25:00.999 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 213 kB/s | 77 kB 00:00 2024-08-17T02:25:01.026 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 238 kB/s | 77 kB 00:00 2024-08-17T02:25:01.325 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 38 kB/s | 11 kB 00:00 2024-08-17T02:25:01.368 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-08-17T02:25:01.634 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 6.6 kB/s | 1.8 kB 00:00 2024-08-17T02:25:01.702 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 6.1 kB/s | 1.8 kB 00:00 2024-08-17T02:25:01.851 INFO:teuthology.orchestra.run.smithi162.stdout:Copr repo for el9 owned by ceph 42 kB/s | 7.6 kB 00:00 2024-08-17T02:25:01.928 INFO:teuthology.orchestra.run.smithi046.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:25:02.428 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-08-17T02:25:04.301 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.2 MB 00:02 2024-08-17T02:25:05.279 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-17T02:25:10.897 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.6 MB 00:01 2024-08-17T02:25:12.656 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 18 kB 00:00 2024-08-17T02:25:13.059 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-08-17T02:25:13.935 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.6 MB 00:01 2024-08-17T02:25:20.168 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 18 kB 00:00 2024-08-17T02:25:20.658 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:25:21.222 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:25:23.312 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:23.313 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:23.324 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:25:23.325 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:25:23.326 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:25:23.327 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:25:23.329 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:25:23.331 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:25:23.332 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:25:23.398 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-08-17T02:25:23.418 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-08-17T02:25:23.418 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-08-17T02:25:23.418 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-08-17T02:25:23.418 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:25:23.419 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:25:23.420 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:25:23.421 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:25:23.422 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:25:23.423 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:25:23.424 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:25:23.425 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:25:23.426 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:25:23.427 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:25:23.428 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:25:23.429 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:25:23.430 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:======================================================================================= 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:Install 121 Packages 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 12 Packages 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 206 M 2024-08-17T02:25:23.431 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-08-17T02:25:24.125 INFO:teuthology.orchestra.run.smithi046.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-08-17T02:25:24.309 INFO:teuthology.orchestra.run.smithi046.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.3 MB/s | 813 kB 00:00 2024-08-17T02:25:24.459 INFO:teuthology.orchestra.run.smithi046.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.1 MB/s | 5.0 MB 00:00 2024-08-17T02:25:24.502 INFO:teuthology.orchestra.run.smithi046.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 713 kB/s | 137 kB 00:00 2024-08-17T02:25:24.735 INFO:teuthology.orchestra.run.smithi046.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 7.5 MB/s | 2.1 MB 00:00 2024-08-17T02:25:24.944 INFO:teuthology.orchestra.run.smithi046.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 1.4 MB 00:00 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi046.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 5.7 MB/s | 3.9 MB 00:00 2024-08-17T02:25:26.599 INFO:teuthology.orchestra.run.smithi046.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 8.4 MB/s | 22 MB 00:02 2024-08-17T02:25:26.687 INFO:teuthology.orchestra.run.smithi046.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 292 kB/s | 25 kB 00:00 2024-08-17T02:25:27.153 INFO:teuthology.orchestra.run.smithi046.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 6.9 MB/s | 15 MB 00:02 2024-08-17T02:25:27.228 INFO:teuthology.orchestra.run.smithi046.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 2.8 MB/s | 215 kB 00:00 2024-08-17T02:25:27.312 INFO:teuthology.orchestra.run.smithi046.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 301 kB/s | 25 kB 00:00 2024-08-17T02:25:27.394 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-08-17T02:25:27.562 INFO:teuthology.orchestra.run.smithi046.stdout:(13/133): ceph-radosgw-17.2.7-1375.g2577e813.el 6.6 MB/s | 14 MB 00:02 2024-08-17T02:25:27.596 INFO:teuthology.orchestra.run.smithi046.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 2.2 MB/s | 636 kB 00:00 2024-08-17T02:25:27.652 INFO:teuthology.orchestra.run.smithi046.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 1.8 MB/s | 163 kB 00:00 2024-08-17T02:25:27.679 INFO:teuthology.orchestra.run.smithi046.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 1.5 MB/s | 126 kB 00:00 2024-08-17T02:25:27.713 INFO:teuthology.orchestra.run.smithi046.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 7.3 MB/s | 458 kB 00:00 2024-08-17T02:25:27.797 INFO:teuthology.orchestra.run.smithi046.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 541 kB/s | 45 kB 00:00 2024-08-17T02:25:27.880 INFO:teuthology.orchestra.run.smithi046.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.4 MB/s | 120 kB 00:00 2024-08-17T02:25:27.956 INFO:teuthology.orchestra.run.smithi046.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 2.4 MB/s | 182 kB 00:00 2024-08-17T02:25:28.031 INFO:teuthology.orchestra.run.smithi046.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 4.8 MB/s | 369 kB 00:00 2024-08-17T02:25:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.0 MB/s | 344 kB 00:00 2024-08-17T02:25:28.190 INFO:teuthology.orchestra.run.smithi046.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.5 MB/s | 116 kB 00:00 2024-08-17T02:25:28.323 INFO:teuthology.orchestra.run.smithi046.stdout:(24/133): librgw2-17.2.7-1375.g2577e813.el9.x86 7.6 MB/s | 4.9 MB 00:00 2024-08-17T02:25:28.348 INFO:teuthology.orchestra.run.smithi046.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 517 kB/s | 82 kB 00:00 2024-08-17T02:25:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.1 MB/s | 165 kB 00:00 2024-08-17T02:25:28.491 INFO:teuthology.orchestra.run.smithi046.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 368 kB/s | 24 kB 00:00 2024-08-17T02:25:28.549 INFO:teuthology.orchestra.run.smithi046.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.1 MB/s | 124 kB 00:00 2024-08-17T02:25:28.671 INFO:teuthology.orchestra.run.smithi046.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 8.5 MB/s | 2.9 MB 00:00 2024-08-17T02:25:28.992 INFO:teuthology.orchestra.run.smithi046.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 7.6 MB/s | 3.4 MB 00:00 2024-08-17T02:25:29.067 INFO:teuthology.orchestra.run.smithi046.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 3.1 MB/s | 240 kB 00:00 2024-08-17T02:25:29.134 INFO:teuthology.orchestra.run.smithi046.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 717 kB/s | 47 kB 00:00 2024-08-17T02:25:29.209 INFO:teuthology.orchestra.run.smithi046.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 195 kB/s | 15 kB 00:00 2024-08-17T02:25:29.293 INFO:teuthology.orchestra.run.smithi046.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.1 MB/s | 269 kB 00:00 2024-08-17T02:25:29.368 INFO:teuthology.orchestra.run.smithi046.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:25:29.444 INFO:teuthology.orchestra.run.smithi046.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 244 kB/s | 18 kB 00:00 2024-08-17T02:25:29.535 INFO:teuthology.orchestra.run.smithi046.stdout:(37/133): ceph-mgr-diskprediction-local-17.2.7- 8.6 MB/s | 7.4 MB 00:00 2024-08-17T02:25:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 222 kB/s | 80 kB 00:00 2024-08-17T02:25:29.923 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:29.924 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:29.934 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:25:29.935 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:25:29.936 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:25:29.937 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:25:29.938 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:25:29.941 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:25:29.942 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:25:29.986 INFO:teuthology.orchestra.run.smithi046.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-08-17T02:25:30.004 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:25:30.023 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:25:30.024 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:25:30.026 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-08-17T02:25:30.027 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-08-17T02:25:30.028 INFO:teuthology.orchestra.run.smithi162.stdout:Install 121 Packages 2024-08-17T02:25:30.028 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 12 Packages 2024-08-17T02:25:30.028 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:25:30.028 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 206 M 2024-08-17T02:25:30.028 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-08-17T02:25:30.095 INFO:teuthology.orchestra.run.smithi046.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-17T02:25:30.203 INFO:teuthology.orchestra.run.smithi046.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-08-17T02:25:30.329 INFO:teuthology.orchestra.run.smithi046.stdout:(42/133): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-08-17T02:25:30.354 INFO:teuthology.orchestra.run.smithi046.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 709 kB/s | 106 kB 00:00 2024-08-17T02:25:30.404 INFO:teuthology.orchestra.run.smithi162.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 36 kB/s | 6.5 kB 00:00 2024-08-17T02:25:30.437 INFO:teuthology.orchestra.run.smithi046.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-17T02:25:30.462 INFO:teuthology.orchestra.run.smithi046.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-08-17T02:25:30.546 INFO:teuthology.orchestra.run.smithi046.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-17T02:25:30.596 INFO:teuthology.orchestra.run.smithi162.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.2 MB/s | 813 kB 00:00 2024-08-17T02:25:30.638 INFO:teuthology.orchestra.run.smithi046.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-08-17T02:25:30.680 INFO:teuthology.orchestra.run.smithi046.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-08-17T02:25:30.682 INFO:teuthology.orchestra.run.smithi162.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.6 MB/s | 137 kB 00:00 2024-08-17T02:25:30.739 INFO:teuthology.orchestra.run.smithi046.stdout:(49/133): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi162.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.2 MB/s | 5.0 MB 00:00 2024-08-17T02:25:30.780 INFO:teuthology.orchestra.run.smithi046.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-08-17T02:25:30.806 INFO:teuthology.orchestra.run.smithi046.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-08-17T02:25:30.846 INFO:teuthology.orchestra.run.smithi162.stdout:(5/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 1.4 MB 00:00 2024-08-17T02:25:30.848 INFO:teuthology.orchestra.run.smithi046.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-08-17T02:25:30.907 INFO:teuthology.orchestra.run.smithi046.stdout:(53/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-08-17T02:25:30.932 INFO:teuthology.orchestra.run.smithi046.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-08-17T02:25:30.957 INFO:teuthology.orchestra.run.smithi046.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-17T02:25:30.971 INFO:teuthology.orchestra.run.smithi162.stdout:(6/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 7.2 MB/s | 2.1 MB 00:00 2024-08-17T02:25:30.982 INFO:teuthology.orchestra.run.smithi046.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-08-17T02:25:31.024 INFO:teuthology.orchestra.run.smithi046.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-17T02:25:31.058 INFO:teuthology.orchestra.run.smithi046.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-08-17T02:25:31.072 INFO:teuthology.orchestra.run.smithi162.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 3.9 MB 00:00 2024-08-17T02:25:31.083 INFO:teuthology.orchestra.run.smithi046.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-08-17T02:25:31.108 INFO:teuthology.orchestra.run.smithi046.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-17T02:25:31.133 INFO:teuthology.orchestra.run.smithi046.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.8 MB/s | 292 kB 00:00 2024-08-17T02:25:31.159 INFO:teuthology.orchestra.run.smithi046.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-08-17T02:25:31.259 INFO:teuthology.orchestra.run.smithi046.stdout:(63/133): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-08-17T02:25:31.335 INFO:teuthology.orchestra.run.smithi046.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 25 MB/s | 4.4 MB 00:00 2024-08-17T02:25:31.377 INFO:teuthology.orchestra.run.smithi046.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 5.8 MB/s | 244 kB 00:00 2024-08-17T02:25:31.469 INFO:teuthology.orchestra.run.smithi046.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-08-17T02:25:31.494 INFO:teuthology.orchestra.run.smithi046.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-08-17T02:25:31.519 INFO:teuthology.orchestra.run.smithi046.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-08-17T02:25:31.545 INFO:teuthology.orchestra.run.smithi046.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-08-17T02:25:31.569 INFO:teuthology.orchestra.run.smithi046.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:25:31.595 INFO:teuthology.orchestra.run.smithi046.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-08-17T02:25:31.637 INFO:teuthology.orchestra.run.smithi046.stdout:(72/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi162.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 22 MB/s | 14 MB 00:00 2024-08-17T02:25:31.737 INFO:teuthology.orchestra.run.smithi046.stdout:(73/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-08-17T02:25:31.771 INFO:teuthology.orchestra.run.smithi046.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-08-17T02:25:31.788 INFO:teuthology.orchestra.run.smithi046.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:25:31.789 INFO:teuthology.orchestra.run.smithi162.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 380 kB/s | 25 kB 00:00 2024-08-17T02:25:31.804 INFO:teuthology.orchestra.run.smithi046.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-08-17T02:25:31.830 INFO:teuthology.orchestra.run.smithi046.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-08-17T02:25:31.855 INFO:teuthology.orchestra.run.smithi046.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-17T02:25:31.880 INFO:teuthology.orchestra.run.smithi046.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:25:31.906 INFO:teuthology.orchestra.run.smithi046.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:25:31.948 INFO:teuthology.orchestra.run.smithi046.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-17T02:25:31.990 INFO:teuthology.orchestra.run.smithi046.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-08-17T02:25:32.314 INFO:teuthology.orchestra.run.smithi162.stdout:(10/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 15 MB 00:01 2024-08-17T02:25:32.365 INFO:teuthology.orchestra.run.smithi162.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 4.2 MB/s | 215 kB 00:00 2024-08-17T02:25:32.440 INFO:teuthology.orchestra.run.smithi162.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 335 kB/s | 25 kB 00:00 2024-08-17T02:25:32.440 INFO:teuthology.orchestra.run.smithi046.stdout:(83/133): ceph-test-17.2.7-1375.g2577e813.el9.x 8.3 MB/s | 48 MB 00:05 2024-08-17T02:25:32.465 INFO:teuthology.orchestra.run.smithi046.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 201 kB/s | 96 kB 00:00 2024-08-17T02:25:32.507 INFO:teuthology.orchestra.run.smithi046.stdout:(85/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-17T02:25:32.531 INFO:teuthology.orchestra.run.smithi162.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 636 kB 00:00 2024-08-17T02:25:32.566 INFO:teuthology.orchestra.run.smithi046.stdout:(86/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 510 kB/s | 64 kB 00:00 2024-08-17T02:25:32.633 INFO:teuthology.orchestra.run.smithi046.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.4 MB/s | 309 kB 00:00 2024-08-17T02:25:32.667 INFO:teuthology.orchestra.run.smithi046.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-17T02:25:32.683 INFO:teuthology.orchestra.run.smithi046.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 424 kB/s | 49 kB 00:00 2024-08-17T02:25:32.701 INFO:teuthology.orchestra.run.smithi046.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-08-17T02:25:32.717 INFO:teuthology.orchestra.run.smithi046.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-08-17T02:25:32.773 INFO:teuthology.orchestra.run.smithi046.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 253 kB/s | 14 kB 00:00 2024-08-17T02:25:32.788 INFO:teuthology.orchestra.run.smithi162.stdout:(14/133): ceph-common-17.2.7-1375.g2577e813.el9 8.8 MB/s | 22 MB 00:02 2024-08-17T02:25:32.810 INFO:teuthology.orchestra.run.smithi046.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 4.7 MB/s | 172 kB 00:00 2024-08-17T02:25:32.815 INFO:teuthology.orchestra.run.smithi162.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 575 kB/s | 163 kB 00:00 2024-08-17T02:25:32.841 INFO:teuthology.orchestra.run.smithi162.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.4 MB/s | 126 kB 00:00 2024-08-17T02:25:32.843 INFO:teuthology.orchestra.run.smithi046.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.0 MB/s | 548 kB 00:00 2024-08-17T02:25:32.874 INFO:teuthology.orchestra.run.smithi162.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 7.7 MB/s | 458 kB 00:00 2024-08-17T02:25:32.877 INFO:teuthology.orchestra.run.smithi046.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:25:32.902 INFO:teuthology.orchestra.run.smithi046.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-08-17T02:25:32.933 INFO:teuthology.orchestra.run.smithi162.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 776 kB/s | 45 kB 00:00 2024-08-17T02:25:32.936 INFO:teuthology.orchestra.run.smithi046.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 2.8 MB/s | 358 kB 00:00 2024-08-17T02:25:32.961 INFO:teuthology.orchestra.run.smithi046.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 303 kB/s | 18 kB 00:00 2024-08-17T02:25:32.986 INFO:teuthology.orchestra.run.smithi046.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:25:33.000 INFO:teuthology.orchestra.run.smithi162.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.8 MB/s | 120 kB 00:00 2024-08-17T02:25:33.003 INFO:teuthology.orchestra.run.smithi046.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2024-08-17T02:25:33.020 INFO:teuthology.orchestra.run.smithi046.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 590 kB/s | 20 kB 00:00 2024-08-17T02:25:33.037 INFO:teuthology.orchestra.run.smithi046.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 270 kB/s | 9.0 kB 00:00 2024-08-17T02:25:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-08-17T02:25:33.071 INFO:teuthology.orchestra.run.smithi046.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-08-17T02:25:33.096 INFO:teuthology.orchestra.run.smithi046.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:25:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-17T02:25:33.134 INFO:teuthology.orchestra.run.smithi162.stdout:(20/133): librgw2-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-17T02:25:33.159 INFO:teuthology.orchestra.run.smithi162.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 1.1 MB/s | 182 kB 00:00 2024-08-17T02:25:33.192 INFO:teuthology.orchestra.run.smithi162.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 6.2 MB/s | 369 kB 00:00 2024-08-17T02:25:33.226 INFO:teuthology.orchestra.run.smithi162.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:25:33.251 INFO:teuthology.orchestra.run.smithi162.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:25:33.277 INFO:teuthology.orchestra.run.smithi162.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:25:33.281 INFO:teuthology.orchestra.run.smithi046.stdout:(107/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-08-17T02:25:33.335 INFO:teuthology.orchestra.run.smithi162.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.8 MB/s | 165 kB 00:00 2024-08-17T02:25:33.339 INFO:teuthology.orchestra.run.smithi046.stdout:(108/133): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-08-17T02:25:33.364 INFO:teuthology.orchestra.run.smithi046.stdout:(109/133): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-08-17T02:25:33.389 INFO:teuthology.orchestra.run.smithi046.stdout:(110/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.9 MB/s | 90 kB 00:00 2024-08-17T02:25:33.415 INFO:teuthology.orchestra.run.smithi046.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-08-17T02:25:33.419 INFO:teuthology.orchestra.run.smithi162.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 18 MB/s | 2.9 MB 00:00 2024-08-17T02:25:33.440 INFO:teuthology.orchestra.run.smithi046.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:25:33.444 INFO:teuthology.orchestra.run.smithi162.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 225 kB/s | 24 kB 00:00 2024-08-17T02:25:33.465 INFO:teuthology.orchestra.run.smithi046.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:25:33.478 INFO:teuthology.orchestra.run.smithi162.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.1 MB/s | 124 kB 00:00 2024-08-17T02:25:33.491 INFO:teuthology.orchestra.run.smithi046.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-17T02:25:33.532 INFO:teuthology.orchestra.run.smithi046.stdout:(115/133): python3-kubernetes-26.1.0-2.el9.noar 2.1 MB/s | 1.0 MB 00:00 2024-08-17T02:25:33.550 INFO:teuthology.orchestra.run.smithi046.stdout:(116/133): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-08-17T02:25:33.575 INFO:teuthology.orchestra.run.smithi046.stdout:(117/133): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-08-17T02:25:33.600 INFO:teuthology.orchestra.run.smithi046.stdout:(118/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-17T02:25:33.625 INFO:teuthology.orchestra.run.smithi046.stdout:(119/133): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-17T02:25:33.659 INFO:teuthology.orchestra.run.smithi046.stdout:(120/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-08-17T02:25:33.718 INFO:teuthology.orchestra.run.smithi046.stdout:(121/133): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-17T02:25:33.770 INFO:teuthology.orchestra.run.smithi162.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 10 MB/s | 3.4 MB 00:00 2024-08-17T02:25:33.928 INFO:teuthology.orchestra.run.smithi162.stdout:(31/133): ceph-mgr-diskprediction-local-17.2.7- 16 MB/s | 7.4 MB 00:00 2024-08-17T02:25:33.954 INFO:teuthology.orchestra.run.smithi162.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.3 MB/s | 240 kB 00:00 2024-08-17T02:25:33.987 INFO:teuthology.orchestra.run.smithi162.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 818 kB/s | 47 kB 00:00 2024-08-17T02:25:34.013 INFO:teuthology.orchestra.run.smithi162.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 249 kB/s | 15 kB 00:00 2024-08-17T02:25:34.063 INFO:teuthology.orchestra.run.smithi162.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.5 MB/s | 269 kB 00:00 2024-08-17T02:25:34.088 INFO:teuthology.orchestra.run.smithi162.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:25:34.101 INFO:teuthology.orchestra.run.smithi046.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 6.5 MB/s | 3.1 MB 00:00 2024-08-17T02:25:34.113 INFO:teuthology.orchestra.run.smithi162.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 364 kB/s | 18 kB 00:00 2024-08-17T02:25:34.151 INFO:teuthology.orchestra.run.smithi046.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 6.0 MB/s | 2.9 MB 00:00 2024-08-17T02:25:34.469 INFO:teuthology.orchestra.run.smithi046.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 3.1 MB/s | 2.3 MB 00:00 2024-08-17T02:25:34.494 INFO:teuthology.orchestra.run.smithi046.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 119 kB/s | 41 kB 00:00 2024-08-17T02:25:34.548 INFO:teuthology.orchestra.run.smithi162.stdout:(38/133): ceph-test-17.2.7-1375.g2577e813.el9.x 17 MB/s | 48 MB 00:02 2024-08-17T02:25:34.577 INFO:teuthology.orchestra.run.smithi046.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.2 MB/s | 247 kB 00:00 2024-08-17T02:25:34.603 INFO:teuthology.orchestra.run.smithi046.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 338 kB/s | 37 kB 00:00 2024-08-17T02:25:34.656 INFO:teuthology.orchestra.run.smithi162.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 141 kB/s | 80 kB 00:00 2024-08-17T02:25:34.686 INFO:teuthology.orchestra.run.smithi046.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.9 MB/s | 207 kB 00:00 2024-08-17T02:25:34.723 INFO:teuthology.orchestra.run.smithi162.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-08-17T02:25:34.765 INFO:teuthology.orchestra.run.smithi162.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-08-17T02:25:34.778 INFO:teuthology.orchestra.run.smithi046.stdout:(129/133): NetworkManager-libnm-1.48.2-2.el9.x8 2.7 MB/s | 1.8 MB 00:00 2024-08-17T02:25:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-08-17T02:25:34.837 INFO:teuthology.orchestra.run.smithi046.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-08-17T02:25:34.845 INFO:teuthology.orchestra.run.smithi162.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-08-17T02:25:34.870 INFO:teuthology.orchestra.run.smithi046.stdout:(131/133): elfutils-libs-0.191-4.el9.x86_64.rpm 971 kB/s | 260 kB 00:00 2024-08-17T02:25:34.874 INFO:teuthology.orchestra.run.smithi162.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-08-17T02:25:34.907 INFO:teuthology.orchestra.run.smithi162.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.0 MB/s | 125 kB 00:00 2024-08-17T02:25:34.933 INFO:teuthology.orchestra.run.smithi162.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:25:34.963 INFO:teuthology.orchestra.run.smithi046.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-08-17T02:25:34.983 INFO:teuthology.orchestra.run.smithi162.stdout:(47/133): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-08-17T02:25:35.021 INFO:teuthology.orchestra.run.smithi046.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-08-17T02:25:35.028 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:35.028 INFO:teuthology.orchestra.run.smithi046.stdout:Total 18 MB/s | 206 MB 00:11 2024-08-17T02:25:35.033 INFO:teuthology.orchestra.run.smithi162.stdout:(48/133): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-08-17T02:25:35.059 INFO:teuthology.orchestra.run.smithi162.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-08-17T02:25:35.092 INFO:teuthology.orchestra.run.smithi162.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-08-17T02:25:35.118 INFO:teuthology.orchestra.run.smithi162.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-08-17T02:25:35.143 INFO:teuthology.orchestra.run.smithi162.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-08-17T02:25:35.168 INFO:teuthology.orchestra.run.smithi162.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-08-17T02:25:35.202 INFO:teuthology.orchestra.run.smithi162.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-08-17T02:25:35.227 INFO:teuthology.orchestra.run.smithi162.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-17T02:25:35.261 INFO:teuthology.orchestra.run.smithi162.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-08-17T02:25:35.311 INFO:teuthology.orchestra.run.smithi162.stdout:(57/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-08-17T02:25:35.370 INFO:teuthology.orchestra.run.smithi162.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-08-17T02:25:35.395 INFO:teuthology.orchestra.run.smithi162.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-08-17T02:25:35.428 INFO:teuthology.orchestra.run.smithi162.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-08-17T02:25:35.454 INFO:teuthology.orchestra.run.smithi162.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-08-17T02:25:35.479 INFO:teuthology.orchestra.run.smithi162.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-17T02:25:35.504 INFO:teuthology.orchestra.run.smithi162.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 468 kB/s | 35 kB 00:00 2024-08-17T02:25:35.671 INFO:teuthology.orchestra.run.smithi162.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-08-17T02:25:35.730 INFO:teuthology.orchestra.run.smithi162.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-08-17T02:25:35.793 INFO:teuthology.orchestra.run.smithi162.stdout:(66/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:25:35.847 INFO:teuthology.orchestra.run.smithi162.stdout:(67/133): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-08-17T02:25:35.923 INFO:teuthology.orchestra.run.smithi162.stdout:(68/133): python3-jsonpointer-2.0-4.el9.noarch. 253 kB/s | 19 kB 00:00 2024-08-17T02:25:36.023 INFO:teuthology.orchestra.run.smithi162.stdout:(69/133): openblas-openmp-0.3.21-2.el9.x86_64.r 8.3 MB/s | 4.7 MB 00:00 2024-08-17T02:25:36.048 INFO:teuthology.orchestra.run.smithi162.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-17T02:25:36.140 INFO:teuthology.orchestra.run.smithi162.stdout:(71/133): python3-babel-2.9.1-2.el9.noarch.rpm 9.4 MB/s | 6.0 MB 00:00 2024-08-17T02:25:36.157 INFO:teuthology.orchestra.run.smithi162.stdout:(72/133): python3-markupsafe-1.1.1-12.el9.x86_6 260 kB/s | 35 kB 00:00 2024-08-17T02:25:36.199 INFO:teuthology.orchestra.run.smithi162.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi162.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-08-17T02:25:36.257 INFO:teuthology.orchestra.run.smithi162.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-17T02:25:36.283 INFO:teuthology.orchestra.run.smithi162.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-08-17T02:25:36.358 INFO:teuthology.orchestra.run.smithi162.stdout:(77/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-08-17T02:25:36.392 INFO:teuthology.orchestra.run.smithi162.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-08-17T02:25:36.417 INFO:teuthology.orchestra.run.smithi162.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-08-17T02:25:36.450 INFO:teuthology.orchestra.run.smithi162.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-08-17T02:25:36.476 INFO:teuthology.orchestra.run.smithi162.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 643 kB/s | 54 kB 00:00 2024-08-17T02:25:36.509 INFO:teuthology.orchestra.run.smithi162.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-08-17T02:25:36.535 INFO:teuthology.orchestra.run.smithi162.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-17T02:25:36.569 INFO:teuthology.orchestra.run.smithi162.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:25:36.594 INFO:teuthology.orchestra.run.smithi162.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:25:36.653 INFO:teuthology.orchestra.run.smithi162.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-08-17T02:25:36.711 INFO:teuthology.orchestra.run.smithi162.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.6 MB/s | 309 kB 00:00 2024-08-17T02:25:36.736 INFO:teuthology.orchestra.run.smithi162.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-08-17T02:25:36.741 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-08-17T02:25:36.762 INFO:teuthology.orchestra.run.smithi162.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 457 kB/s | 49 kB 00:00 2024-08-17T02:25:36.787 INFO:teuthology.orchestra.run.smithi162.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:25:36.812 INFO:teuthology.orchestra.run.smithi162.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:25:36.829 INFO:teuthology.orchestra.run.smithi162.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 852 kB/s | 14 kB 00:00 2024-08-17T02:25:36.871 INFO:teuthology.orchestra.run.smithi162.stdout:(93/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.0 MB/s | 548 kB 00:00 2024-08-17T02:25:36.896 INFO:teuthology.orchestra.run.smithi162.stdout:(94/133): python3-cheroot-8.6.0-4.el9.noarch.rp 2.5 MB/s | 172 kB 00:00 2024-08-17T02:25:36.951 INFO:teuthology.orchestra.run.smithi162.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 3.9 MB/s | 220 kB 00:00 2024-08-17T02:25:36.970 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-08-17T02:25:36.971 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-08-17T02:25:36.980 INFO:teuthology.orchestra.run.smithi162.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:25:37.005 INFO:teuthology.orchestra.run.smithi162.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 198 kB/s | 11 kB 00:00 2024-08-17T02:25:37.031 INFO:teuthology.orchestra.run.smithi162.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 352 kB/s | 18 kB 00:00 2024-08-17T02:25:37.056 INFO:teuthology.orchestra.run.smithi162.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 461 kB/s | 23 kB 00:00 2024-08-17T02:25:37.081 INFO:teuthology.orchestra.run.smithi162.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-17T02:25:37.107 INFO:teuthology.orchestra.run.smithi162.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-17T02:25:37.132 INFO:teuthology.orchestra.run.smithi162.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 181 kB/s | 9.0 kB 00:00 2024-08-17T02:25:37.157 INFO:teuthology.orchestra.run.smithi162.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 820 kB/s | 41 kB 00:00 2024-08-17T02:25:37.182 INFO:teuthology.orchestra.run.smithi162.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:25:37.200 INFO:teuthology.orchestra.run.smithi162.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-08-17T02:25:37.225 INFO:teuthology.orchestra.run.smithi162.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:25:37.259 INFO:teuthology.orchestra.run.smithi162.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:25:37.284 INFO:teuthology.orchestra.run.smithi162.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-08-17T02:25:37.309 INFO:teuthology.orchestra.run.smithi162.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:37.351 INFO:teuthology.orchestra.run.smithi162.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-08-17T02:25:37.376 INFO:teuthology.orchestra.run.smithi162.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2024-08-17T02:25:37.402 INFO:teuthology.orchestra.run.smithi162.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:25:37.427 INFO:teuthology.orchestra.run.smithi162.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:25:37.452 INFO:teuthology.orchestra.run.smithi162.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-08-17T02:25:37.477 INFO:teuthology.orchestra.run.smithi162.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-17T02:25:37.503 INFO:teuthology.orchestra.run.smithi162.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:37.528 INFO:teuthology.orchestra.run.smithi162.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:25:37.553 INFO:teuthology.orchestra.run.smithi162.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-08-17T02:25:37.587 INFO:teuthology.orchestra.run.smithi162.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-08-17T02:25:37.646 INFO:teuthology.orchestra.run.smithi162.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:25:37.846 INFO:teuthology.orchestra.run.smithi162.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:25:37.988 INFO:teuthology.orchestra.run.smithi162.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 8.6 MB/s | 2.9 MB 00:00 2024-08-17T02:25:38.039 INFO:teuthology.orchestra.run.smithi162.stdout:(123/133): librados2-17.2.7-1375.g2577e813.el9. 6.8 MB/s | 3.1 MB 00:00 2024-08-17T02:25:38.113 INFO:teuthology.orchestra.run.smithi162.stdout:(124/133): NetworkManager-libnm-1.48.2-2.el9.x8 14 MB/s | 1.8 MB 00:00 2024-08-17T02:25:38.164 INFO:teuthology.orchestra.run.smithi162.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 325 kB/s | 41 kB 00:00 2024-08-17T02:25:38.189 INFO:teuthology.orchestra.run.smithi162.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 3.2 MB/s | 247 kB 00:00 2024-08-17T02:25:38.239 INFO:teuthology.orchestra.run.smithi162.stdout:(127/133): NetworkManager-1.48.2-2.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-08-17T02:25:38.264 INFO:teuthology.orchestra.run.smithi162.stdout:(128/133): elfutils-debuginfod-client-0.191-4.e 365 kB/s | 37 kB 00:00 2024-08-17T02:25:38.290 INFO:teuthology.orchestra.run.smithi162.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.0 MB/s | 207 kB 00:00 2024-08-17T02:25:38.315 INFO:teuthology.orchestra.run.smithi162.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.4 MB/s | 260 kB 00:00 2024-08-17T02:25:38.424 INFO:teuthology.orchestra.run.smithi162.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-08-17T02:25:38.457 INFO:teuthology.orchestra.run.smithi162.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 7.7 MB/s | 1.1 MB 00:00 2024-08-17T02:25:38.524 INFO:teuthology.orchestra.run.smithi162.stdout:(133/133): openssl-3.2.2-2.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-08-17T02:25:38.528 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:38.528 INFO:teuthology.orchestra.run.smithi162.stdout:Total 24 MB/s | 206 MB 00:08 2024-08-17T02:25:39.170 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-08-17T02:25:39.171 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-08-17T02:25:40.230 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-08-17T02:25:40.442 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-08-17T02:25:40.442 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-08-17T02:25:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-08-17T02:25:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-08-17T02:25:45.152 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-08-17T02:25:45.268 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:45.318 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:45.394 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:45.437 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:45.468 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:45.529 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:45.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:45.969 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:46.090 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:46.121 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.188 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-08-17T02:25:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.278 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:48.329 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:48.403 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:48.449 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:48.487 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:48.540 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:48.542 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:48.627 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:48.711 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:48.876 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:48.884 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:48.909 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:49.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:49.062 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:49.141 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:49.143 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:49.171 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:49.233 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:49.301 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:49.308 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:49.354 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:49.450 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:49.620 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:49.684 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:49.781 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:49.807 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:49.908 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:49.965 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:50.000 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:50.123 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:50.151 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:50.297 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:50.362 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:50.469 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:50.520 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:50.562 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:50.570 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:50.615 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:50.653 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:50.707 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:50.757 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:50.843 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:50.949 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:51.051 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:51.408 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:51.466 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:51.510 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:51.598 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:51.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:51.659 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:51.670 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:51.692 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:51.762 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:51.782 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:51.805 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:51.841 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:51.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:51.879 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:51.901 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:51.927 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:51.952 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:52.002 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:52.006 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:52.041 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:52.087 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:52.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:52.184 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:52.242 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:52.285 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:52.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:52.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:52.415 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:52.459 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:52.501 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:52.532 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:52.569 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:52.624 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:52.661 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:52.696 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:52.729 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:52.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:52.805 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:52.832 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:52.883 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:53.012 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:53.071 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:53.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:53.188 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:53.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:53.307 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:53.351 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:53.389 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:53.442 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:53.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:53.542 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:53.643 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:53.690 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:53.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:53.789 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:54.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:54.064 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:54.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:54.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:54.138 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:54.215 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:54.264 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:54.310 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:54.354 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:54.397 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:54.502 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:54.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:54.536 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:54.554 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:54.602 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:54.642 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:54.644 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:54.681 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:54.719 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:54.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:54.800 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:54.833 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:54.876 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:54.909 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:54.945 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:54.993 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:55.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:55.191 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:55.516 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:55.660 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:56.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:56.135 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:56.169 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:56.282 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:56.339 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:56.565 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:56.599 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:56.701 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:57.335 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:57.424 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:57.460 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:57.492 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:25:57.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:57.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:25:57.862 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:57.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:57.979 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:58.006 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:25:59.560 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:59.690 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:59.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:59.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:26:00.111 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:26:00.153 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:26:00.270 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:26:00.297 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:26:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:00.819 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:01.436 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:01.481 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:01.616 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:01.616 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:26:01.616 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:26:01.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:01.656 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:02.916 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:02.960 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:03.558 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:03.623 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:03.762 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:03.762 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:26:03.762 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:26:03.762 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:03.798 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:14.103 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-08-17T02:26:14.104 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-08-17T02:26:14.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:14.307 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:14.343 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:14.343 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:14.343 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:26:14.343 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:15.868 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:15.927 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:15.927 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:15.927 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:26:15.927 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:15.927 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:15.928 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:15.968 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:15.968 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-08-17T02:26:15.968 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-08-17T02:26:15.969 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:16.168 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:16.169 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:26:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:16.221 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:16.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:16.701 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:16.701 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:16.701 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:26:16.701 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:16.701 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:16.702 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:16.826 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:26:16.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:26:16.984 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:26:17.219 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:26:17.295 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:26:17.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:26:17.501 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:26:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:26:17.694 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:17.725 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:26:17.750 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:26:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:17.751 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:17.751 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:26:17.752 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:17.752 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:17.778 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:26:17.818 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:26:17.843 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:26:17.977 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:18.028 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:18.373 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:18.401 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:18.431 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:26:18.436 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:18.487 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:18.494 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:26:18.523 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:18.620 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:26:18.681 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:26:18.753 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:26:18.997 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:26:19.050 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:26:19.136 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:26:19.237 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:26:19.419 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:26:19.471 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:26:19.496 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:26:19.533 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:26:19.573 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:26:19.599 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:26:19.745 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:19.784 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:20.136 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:20.165 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:20.195 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:26:20.256 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:20.931 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:20.967 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:21.109 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:21.279 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:26:21.311 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:21.364 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:21.365 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:21.365 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:26:21.365 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:21.365 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:21.365 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:21.420 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:21.447 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:21.449 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:21.498 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:21.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:26:21.620 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:26:22.587 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:22.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:22.752 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:22.910 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:26:22.942 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:22.994 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:26:23.051 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:23.056 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:23.077 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:23.170 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:23.171 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:23.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:26:23.240 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:26:23.241 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:23.290 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:26:23.290 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:23.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:23.401 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:23.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:23.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:23.785 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:26:23.785 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:23.786 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:23.786 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:24.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:26:24.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:24.726 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:24.772 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:24.821 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:24.821 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:24.821 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:26:24.821 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:24.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:24.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:25.257 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:25.308 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:28.763 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:26:28.805 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:26:28.849 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:26:28.886 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:26:28.919 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:26:28.954 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:26:28.985 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:26:29.017 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:29.065 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:26:30.044 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:26:30.085 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:26:30.130 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:26:30.168 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:26:30.201 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:26:30.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:26:30.284 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:26:30.315 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:30.364 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:26:30.441 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:26:30.702 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:26:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:26:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:26:30.931 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:26:30.964 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:26:30.988 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:26:31.014 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:31.043 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:26:31.043 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:31.142 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:31.204 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:26:31.204 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:31.318 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:31.342 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:31.363 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:31.363 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:31.611 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:31.611 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:31.679 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:26:31.721 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:31.753 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:31.781 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:31.855 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:31.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:26:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:26:32.038 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:32.038 INFO:teuthology.orchestra.run.smithi046.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:32.038 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:32.050 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:26:32.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:26:32.180 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:26:32.205 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:26:32.231 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:32.259 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:26:32.260 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:32.385 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:32.417 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:26:32.417 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:32.527 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:32.551 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:32.568 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:32.568 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:32.812 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:32.813 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:32.989 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:33.062 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:33.258 INFO:teuthology.orchestra.run.smithi162.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:33.258 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:36.895 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:36.896 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:36.897 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:36.909 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:36.910 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:36.911 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:36.912 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:36.913 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:36.914 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:36.915 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:36.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:36.917 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:36.918 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:38.548 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:38.549 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:38.550 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:38.561 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:38.562 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:38.563 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:38.564 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:38.565 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:38.566 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:38.567 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:38.568 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:38.569 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:38.570 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:38.949 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:38.949 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:38.949 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-08-17T02:26:38.949 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:38.950 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.952 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.953 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:38.954 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:38.955 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:38.956 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:38.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:38.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:38.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.960 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:38.961 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-08-17T02:26:39.611 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:40.469 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:40.470 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:40.471 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:40.471 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:40.471 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:40.471 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:40.471 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:40.472 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.474 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:40.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:40.476 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:40.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:40.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:40.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:40.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:40.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:40.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:40.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:40.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:40.484 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:40.485 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:40.486 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:40.486 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:40.486 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-08-17T02:26:41.089 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:41.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:41.235 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:41.284 INFO:teuthology.orchestra.run.smithi046.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:41.285 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:41.285 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:41.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:41.433 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:41.480 INFO:teuthology.orchestra.run.smithi162.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:41.480 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:41.480 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:41.482 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:26:41.482 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:41.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:41.543 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:41.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:41.602 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:26:41.603 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:41.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:41.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:41.765 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:41.765 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:41.822 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:41.918 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:26:41.919 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:41.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:41.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:42.074 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:42.074 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:42.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:42.234 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:26:42.235 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:42.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:42.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:42.389 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:42.389 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:42.445 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:42.542 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:26:42.643 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:26:42.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:42.649 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:42.706 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:26:42.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:42.710 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:42.767 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:26:42.767 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:42.771 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:42.833 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:26:42.833 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:26:42.833 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:26:42.833 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:42.834 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:42.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.093 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:43.093 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:43.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.305 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:43.366 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:26:43.366 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:26:43.367 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858283', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAhwVYS96B2JdJgt/w7jUZAWCzKQt9CZ8t+ZyaVvRQjNJIrH7nqVev1zYiYztx+uLF9sO33EARzwXc1kKj5pcGE=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzoQQmv0eJPLOt7M2sTzixbH3S5rfSFR5vXhXJ9fpYznEttbSa7pqm7pHf9PgKoIKB/DyZnbncO4CgaiMGcoBY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:26:43.367 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:43.371 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:43.406 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:43.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:43.503 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:43.503 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:43.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:43.539 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:43.613 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:43.613 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-08-17 02:26:32.382869140 +0000 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-08-17 02:24:11.945065650 +0000 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-08-17 02:24:11.945065650 +0000 2024-08-17T02:26:43.614 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-08-17 02:24:11.945065650 +0000 2024-08-17T02:26:43.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:43.707 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-08-17T02:26:43.707 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-08-17T02:26:43.708 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000227802 s, 2.2 MB/s 2024-08-17T02:26:43.710 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:43.747 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:43.824 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-08-17 02:26:32.382869140 +0000 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-08-17 02:24:12.438060672 +0000 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-08-17 02:24:12.438060672 +0000 2024-08-17T02:26:43.825 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-08-17 02:24:12.438060672 +0000 2024-08-17T02:26:43.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-08-17T02:26:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-08-17T02:26:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000172261 s, 3.0 MB/s 2024-08-17T02:26:43.920 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:43.956 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:44.031 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:44.031 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:44.031 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-08-17 02:26:32.383869130 +0000 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-08-17 02:24:12.883056178 +0000 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-08-17 02:24:12.883056178 +0000 2024-08-17T02:26:44.032 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-08-17 02:24:12.883056178 +0000 2024-08-17T02:26:44.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-08-17T02:26:44.124 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-08-17T02:26:44.125 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000181254 s, 2.8 MB/s 2024-08-17T02:26:44.127 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:44.163 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-08-17 02:26:32.384869120 +0000 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-08-17 02:24:13.342051544 +0000 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-08-17 02:24:13.342051544 +0000 2024-08-17T02:26:44.238 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-08-17 02:24:13.342051544 +0000 2024-08-17T02:26:44.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:44.331 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-08-17T02:26:44.331 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-08-17T02:26:44.331 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000180476 s, 2.8 MB/s 2024-08-17T02:26:44.333 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:44.370 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:44.371 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:44.371 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:44.409 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:44.409 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:44.486 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:44.486 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-17 02:26:33.597915651 +0000 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-17 02:24:06.505250407 +0000 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-17 02:24:06.505250407 +0000 2024-08-17T02:26:44.487 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-17 02:24:06.505250407 +0000 2024-08-17T02:26:44.487 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:44.580 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-17T02:26:44.581 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-17T02:26:44.581 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000295043 s, 1.7 MB/s 2024-08-17T02:26:44.583 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:44.620 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:44.695 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-17 02:26:33.597915651 +0000 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-17 02:24:06.945241690 +0000 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-17 02:24:06.945241690 +0000 2024-08-17T02:26:44.696 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-17 02:24:06.945241690 +0000 2024-08-17T02:26:44.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:44.789 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-17T02:26:44.789 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-17T02:26:44.790 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000295812 s, 1.7 MB/s 2024-08-17T02:26:44.792 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:44.829 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-17 02:26:33.598915631 +0000 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-17 02:24:07.430232082 +0000 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-17 02:24:07.430232082 +0000 2024-08-17T02:26:44.905 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-17 02:24:07.430232082 +0000 2024-08-17T02:26:44.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:44.997 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-17T02:26:44.997 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-17T02:26:44.997 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000279844 s, 1.8 MB/s 2024-08-17T02:26:45.000 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:45.036 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:45.111 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:45.111 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:26:45.111 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-08-17 02:26:33.599915612 +0000 2024-08-17T02:26:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-08-17 02:24:07.898222811 +0000 2024-08-17T02:26:45.112 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-08-17 02:24:07.898222811 +0000 2024-08-17T02:26:45.112 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-08-17 02:24:07.898222811 +0000 2024-08-17T02:26:45.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:45.205 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-08-17T02:26:45.205 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-08-17T02:26:45.205 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000478652 s, 1.1 MB/s 2024-08-17T02:26:45.207 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:45.244 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:45.244 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:45.244 INFO:tasks.ceph:Generating config... 2024-08-17T02:26:45.245 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:26:45.245 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:26:45.245 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:26:45.245 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:26:45.246 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:26:45.246 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:26:45.246 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:26:45.246 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:26:45.247 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:26:45.247 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:26:45.248 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:26:45.248 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:26:45.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:45.337 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:26:45.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:26:45.423 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:45.479 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-08-17T02:26:45.479 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:26:45.480 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:45.480 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:45.515 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid cdf034cd-9476-4b1b-a305-19ec575459d2 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = octopus 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:fsid cdf034cd-9476-4b1b-a305-19ec575459d2 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-08-17T02:26:45.627404+0000 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-08-17T02:26:45.627404+0000 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 15 (octopus) 2024-08-17T02:26:45.627 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-08-17T02:26:45.628 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-08-17T02:26:45.628 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-08-17T02:26:45.628 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-08-17T02:26:45.628 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:26:45.629 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:45.664 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cdf034cd-9476-4b1b-a305-19ec575459d2... 2024-08-17T02:26:45.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:45.709 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:45.803 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-08-17T02:26:45.803 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-08-17T02:26:45.803 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:45.804 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-08-17T02:26:45.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.804 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-08-17T02:26:45.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.804 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-08-17T02:26:45.805 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-08-17T02:26:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:45.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-08-17T02:26:45.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-08-17T02:26:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:45.809 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-08-17T02:26:45.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-08-17T02:26:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-08-17T02:26:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-08-17T02:26:45.811 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-08-17T02:26:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on skipped message = False 2024-08-17T02:26:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = cdf034cd-9476-4b1b-a305-19ec575459d2 2024-08-17T02:26:45.812 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-08-17T02:26:45.813 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-08-17T02:26:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.814 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-08-17T02:26:45.815 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-08-17T02:26:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.816 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-08-17T02:26:45.817 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-08-17T02:26:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2024-08-17T02:26:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2024-08-17T02:26:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2024-08-17T02:26:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-08-17T02:26:45.818 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-08-17T02:26:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-08-17T02:26:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-08-17T02:26:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-08-17T02:26:45.819 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-08-17T02:26:45.820 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-08-17T02:26:45.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:45.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:45.820 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:45.820 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-08-17T02:26:45.821 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-08-17T02:26:45.822 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-08-17T02:26:45.822 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: debug finisher = 20 2024-08-17T02:26:45.823 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.824 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-08-17T02:26:45.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-08-17T02:26:45.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-08-17T02:26:45.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-08-17T02:26:45.824 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-08-17T02:26:45.825 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:45.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.826 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:45.826 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:45.826 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:45.826 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.827 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:45.827 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:45.827 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:45.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.828 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-08-17T02:26:45.828 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:45.828 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.828 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-08-17T02:26:45.829 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-08-17T02:26:45.830 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = "" 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-08-17T02:26:45.831 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-08-17T02:26:45.832 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-08-17T02:26:45.833 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-08-17T02:26:45.833 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-08-17T02:26:45.833 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-08-17T02:26:45.833 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-08-17T02:26:45.833 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-08-17T02:26:45.834 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-08-17T02:26:45.834 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-08-17T02:26:45.834 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-08-17T02:26:45.837 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-08-17T02:26:45.837 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-08-17T02:26:45.837 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:45.837 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-08-17T02:26:45.837 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.838 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-08-17T02:26:45.838 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.838 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:45.838 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.838 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.839 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:45.840 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.841 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-08-17T02:26:45.841 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.841 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:45.841 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-08-17T02:26:45.841 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:45.842 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:45.842 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:45.842 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:45.842 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:45.843 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-08-17T02:26:45.844 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-08-17T02:26:45.845 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-08-17T02:26:45.845 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.46,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-08-17T02:26:45.845 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-08-17T02:26:45.845 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = cdf034cd-9476-4b1b-a305-19ec575459d2 2024-08-17T02:26:45.845 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.846 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-08-17T02:26:45.846 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-08-17T02:26:45.846 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.846 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:45.846 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.847 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-08-17T02:26:45.848 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-08-17T02:26:45.848 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:45.848 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.849 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-08-17T02:26:45.849 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-08-17T02:26:45.849 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.849 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:45.849 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.850 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-08-17T02:26:45.850 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.850 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-08-17T02:26:45.850 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.850 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:45.851 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:45.851 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.851 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-08-17T02:26:45.851 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-08-17T02:26:45.851 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-08-17T02:26:45.852 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-08-17T02:26:45.852 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-08-17T02:26:45.852 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-08-17T02:26:45.852 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-08-17T02:26:45.852 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:45.853 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:45.854 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:45.854 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:45.854 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-08-17T02:26:45.854 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-08-17T02:26:45.854 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.855 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-08-17T02:26:45.855 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-17T02:26:45.855 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-08-17T02:26:45.855 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-08-17T02:26:45.856 INFO:teuthology.orchestra.run.smithi162.stdout: debug finisher = 20 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-08-17T02:26:45.857 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-08-17T02:26:45.858 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:45.859 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.859 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:45.859 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:45.859 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:45.859 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-08-17T02:26:45.860 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:45.861 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.861 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:45.861 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-08-17T02:26:45.861 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-08-17T02:26:45.861 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-08-17T02:26:45.862 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-08-17T02:26:45.862 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-08-17T02:26:45.862 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-08-17T02:26:45.862 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-08-17T02:26:45.863 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-08-17T02:26:45.864 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-08-17T02:26:45.865 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-08-17T02:26:45.866 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-08-17T02:26:45.866 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-08-17T02:26:45.866 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-08-17T02:26:45.866 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-08-17T02:26:45.867 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-08-17T02:26:45.867 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-08-17T02:26:45.867 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-08-17T02:26:45.867 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:26:45.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:26:45.958 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:26:45.958 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:45.958 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:26:45.995 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:45.996 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:26:46.071 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:26:46.071 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:46.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:46.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:46.189 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:26:46.189 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:46.264 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:26:46.264 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:46.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:46.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:46.343 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:26:46.343 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:46.418 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:26:46.418 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:26:46.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:46.516 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:46.522 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:46.626 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:46.632 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:26:46.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:46.730 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:46.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:26:46.791 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:46.889 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:46.893 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:26:46.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:47.048 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:47.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:26:47.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:47.207 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:47.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:26:47.267 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:26:47.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:47.344 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:47.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:47.445 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:47.472 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:47.547 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:47.574 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:47.649 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:47.675 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:26:47.675 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:47.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:47.732 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:47.732 INFO:tasks.ceph:role: osd.0 2024-08-17T02:26:47.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:26:47.732 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:47.786 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:47.787 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:47.820 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-08-17T02:26:47.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-08-17T02:26:47.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:47.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:47.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:48.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:48.025 INFO:tasks.ceph:role: osd.1 2024-08-17T02:26:48.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:26:48.025 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:48.081 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:48.082 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:48.082 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:48.115 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-08-17T02:26:48.120 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-08-17T02:26:48.120 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:48.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:48.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:48.318 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:48.318 INFO:tasks.ceph:role: osd.2 2024-08-17T02:26:48.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:26:48.319 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:48.374 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:48.375 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:48.409 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-08-17T02:26:48.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-08-17T02:26:48.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:48.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:48.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:48.616 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:48.616 INFO:tasks.ceph:role: osd.3 2024-08-17T02:26:48.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:26:48.616 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:48.675 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:48.708 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-08-17T02:26:48.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-08-17T02:26:48.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:48.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:48.860 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:48.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.961+0000 7f7b698152c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:26:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.962+0000 7f7b698152c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:26:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.962+0000 7f7b698152c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.962+0000 7f7b698152c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.962+0000 7f7b698152c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:48.964+0000 7f7b698152c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:26:49.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:49.509+0000 7f7b698152c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:50.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:50.271+0000 7f7b698152c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:51.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:51.041+0000 7f7b698152c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:51.884 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:51.945 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.032+0000 7f7b018082c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.032+0000 7f7b018082c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.032+0000 7f7b018082c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.032+0000 7f7b018082c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:52.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.032+0000 7f7b018082c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:52.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.034+0000 7f7b018082c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:26:52.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:52.582+0000 7f7b018082c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:53.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:53.342+0000 7f7b018082c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:54.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:54.123+0000 7f7b018082c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:54.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:55.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:55.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.087+0000 7fa7d3a0f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:26:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.088+0000 7fa7d3a0f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:26:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.088+0000 7fa7d3a0f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.088+0000 7fa7d3a0f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:55.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.088+0000 7fa7d3a0f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:55.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.089+0000 7fa7d3a0f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:26:55.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:55.634+0000 7fa7d3a0f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:56.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:56.398+0000 7fa7d3a0f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:57.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:57.171+0000 7fa7d3a0f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:58.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:58.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:58.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.148+0000 7f749480f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:26:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.149+0000 7f749480f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:26:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.149+0000 7f749480f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.149+0000 7f749480f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:58.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.149+0000 7f749480f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:58.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.151+0000 7f749480f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:26:58.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:58.696+0000 7f749480f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:59.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:26:59.464+0000 7f749480f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:00.238+0000 7f749480f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:01.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:27:01.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:01.195 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:01.195 INFO:tasks.ceph:role: osd.4 2024-08-17T02:27:01.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:27:01.195 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:01.260 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:01.261 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:01.668 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-17T02:27:01.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-17T02:27:01.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:01.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:01.850 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:01.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:01.907 INFO:tasks.ceph:role: osd.5 2024-08-17T02:27:01.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:27:01.907 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:27:01.973 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:01.973 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:01.974 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:02.332 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-17T02:27:02.338 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-17T02:27:02.338 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:02.423 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:02.485 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:02.542 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:02.543 INFO:tasks.ceph:role: osd.6 2024-08-17T02:27:02.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:27:02.543 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:27:02.605 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:02.606 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:02.985 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-17T02:27:02.988 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-17T02:27:02.989 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:03.085 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:03.147 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:03.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:03.203 INFO:tasks.ceph:role: osd.7 2024-08-17T02:27:03.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:27:03.203 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:03.266 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:03.267 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:03.653 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-08-17T02:27:03.656 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-08-17T02:27:03.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:03.793 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:03.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:03.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.961+0000 7fd1c4a4c2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:27:03.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.967+0000 7fd1c4a4c2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:27:03.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.967+0000 7fd1c4a4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.967+0000 7fd1c4a4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.967+0000 7fd1c4a4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:03.972+0000 7fd1c4a4c2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:27:04.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:04.510+0000 7fd1c4a4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:05.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:05.286+0000 7fd1c4a4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:06.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:06.047+0000 7fd1c4a4c2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:06.873 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:06.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:07.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.016+0000 7fac6740e2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:27:07.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.016+0000 7fac6740e2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:27:07.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.017+0000 7fac6740e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:07.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.017+0000 7fac6740e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:07.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.017+0000 7fac6740e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:07.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.018+0000 7fac6740e2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:27:07.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:07.556+0000 7fac6740e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:08.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:08.327+0000 7fac6740e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:09.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:09.093+0000 7fac6740e2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:09.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:09.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:10.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.065+0000 7f89282112c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:27:10.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.066+0000 7f89282112c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:27:10.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.066+0000 7f89282112c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:10.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.066+0000 7f89282112c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:10.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.066+0000 7f89282112c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:10.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.067+0000 7f89282112c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:27:10.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:10.613+0000 7f89282112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:11.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:11.382+0000 7f89282112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:12.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:12.153+0000 7f89282112c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:12.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:13.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:13.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.113+0000 7f35d9c0a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:27:13.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.114+0000 7f35d9c0a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:27:13.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.114+0000 7f35d9c0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:13.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.114+0000 7f35d9c0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:13.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.114+0000 7f35d9c0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:13.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.115+0000 7f35d9c0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:27:13.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:13.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:13.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:13.664+0000 7f35d9c0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:14.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:14.439+0000 7f35d9c0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:15.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:15.210+0000 7f35d9c0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:16.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:16.109 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:27:16.109 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:27:16.172 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:27:16.271 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:27:16.368 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:27:16.465 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:27:16.560 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:27:16.657 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:16.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:27:16.753 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:16.753 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:27:16.811 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:16.811 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:27:16.907 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:16.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:27:17.003 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.003 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:27:17.099 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.099 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:27:17.194 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:27:17.290 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:27:17.385 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:17.385 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:27:17.424 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:17.424 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:27:17.501 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.502 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:27:17.536 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:17.536 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:27:17.611 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:27:17.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:17.615 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:17.667 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBmCsBmonHVHhAAxNV3AwTtq0ZbzTdn6uyz9w== 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBmCsBmrXWWKxAAdVrIugKIdj3GLyukSDGh+A== 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBmCsBmJmQJNRAAoRZ1wZaOEIszQNIBR83rHg== 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBoCsBmHs9jORAANOS/jokpQP2pK8jLIjAgIw== 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBsCsBmKdf7ARAAq9Q37E3Hl0ukp5bUcxkNcQ== 2024-08-17T02:27:17.668 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBvCsBmH7BMBRAA60UxxwS/JA6/XmWeiw13rg== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQByCsBm37PyCBAAXtfOPCbWHHrU+gd0L5hrEg== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBmCsBmyAFbJRAAf/MO8LhtNIa8OnEBb2wOUQ== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBmo6PmAhAACwLo/s6gKBZD4QmCb11YIA== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBmLjtfDBAA4kuCETIapveiTwbRdb/8Dg== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB3CsBmu4FnORAAlaghmbp2rjtE6iSWqa2OqQ== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB7CsBmQjD9ABAA2TRswJ+m2zspGKKNUhbEOQ== 2024-08-17T02:27:17.669 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQB+CsBmkwfrAxAAXRkLIQV0vtcL3N0rfI569A== 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCBCsBmQt3JBhAAXaALqFhWUNounntsvosqnw== 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBmzn+JFBAASPIzKn+yOLLZFpT6Mly4wg== 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:[client.2] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBm7EeYGhAADKlp+1XFbuWrfn1X0zeu7Q== 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBmPlStIBAAqXgQfLQJMU6LSR+J1eJgow== 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout:[client.3] 2024-08-17T02:27:17.670 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBnCsBmsWi2JhAAhx2GJK6dvPOtMwgY1sGQ9A== 2024-08-17T02:27:17.703 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-08-17T02:27:17.703 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBmCsBmonHVHhAAxNV3AwTtq0ZbzTdn6uyz9w== 2024-08-17T02:27:17.703 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBmCsBmrXWWKxAAdVrIugKIdj3GLyukSDGh+A== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBmCsBmJmQJNRAAoRZ1wZaOEIszQNIBR83rHg== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBoCsBmHs9jORAANOS/jokpQP2pK8jLIjAgIw== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBsCsBmKdf7ARAAq9Q37E3Hl0ukp5bUcxkNcQ== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBvCsBmH7BMBRAA60UxxwS/JA6/XmWeiw13rg== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQByCsBm37PyCBAAXtfOPCbWHHrU+gd0L5hrEg== 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-08-17T02:27:17.704 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBmCsBmyAFbJRAAf/MO8LhtNIa8OnEBb2wOUQ== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBmo6PmAhAACwLo/s6gKBZD4QmCb11YIA== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBmLjtfDBAA4kuCETIapveiTwbRdb/8Dg== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB3CsBmu4FnORAAlaghmbp2rjtE6iSWqa2OqQ== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB7CsBmQjD9ABAA2TRswJ+m2zspGKKNUhbEOQ== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB+CsBmkwfrAxAAXRkLIQV0vtcL3N0rfI569A== 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-08-17T02:27:17.705 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCBCsBmQt3JBhAAXaALqFhWUNounntsvosqnw== 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBmzn+JFBAASPIzKn+yOLLZFpT6Mly4wg== 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBm7EeYGhAADKlp+1XFbuWrfn1X0zeu7Q== 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBmPlStIBAAqXgQfLQJMU6LSR+J1eJgow== 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-08-17T02:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBnCsBmsWi2JhAAhx2GJK6dvPOtMwgY1sGQ9A== 2024-08-17T02:27:17.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:17.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:17.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.839 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:18.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.117 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.205 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.209 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.296 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.300 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.388 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:18.391 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:18.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:18.484 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:18.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:18.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:18.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.671 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.762 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.849 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.943 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:19.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.034 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.127 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.315 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:19.404 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:27:19.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:19.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:19.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:19.618 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:19.674 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:19.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:19.831 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:19.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:19.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:20.040 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:20.044 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:20.079 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:27:20.079 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:27:20.079 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:27:20.120 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:27:20.120 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:27:20.120 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:27:20.124 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:27:20.124 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:27:20.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:27:20.128 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:27:20.128 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:27:20.128 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:27:20.128 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:27:20.132 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:27:20.132 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:27:20.132 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:27:20.136 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:27:20.137 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:27:20.137 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:27:20.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.287+0000 7f5dfbc00640 1 Processor -- start 2024-08-17T02:27:20.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.287+0000 7f5dfbc00640 1 -- start start 2024-08-17T02:27:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.288+0000 7f5dfbc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.288+0000 7f5dfbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.288+0000 7f5dfbc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40b11d0 con 0x7f5df40d0490 2024-08-17T02:27:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.288+0000 7f5dfbc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40b0650 con 0x7f5df4159200 2024-08-17T02:27:20.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.288+0000 7f5dfbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b08a0 con 0x7f5df40ae0d0 2024-08-17T02:27:20.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:53838/0 (socket says 172.21.15.46:53838) 2024-08-17T02:27:20.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 learned_addr learned my addr 172.21.15.46:0/2863149676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5df40b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5df40b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9200640 1 -- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 msgr2=0x7f5df40aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9200640 1 -- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 msgr2=0x7f5df40aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.289+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:20.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9200640 1 -- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 msgr2=0x7f5df40aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9200640 1 -- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 msgr2=0x7f5df40aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5df40b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5df40b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:20.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.490+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316698113 0 0) 0x7f5df40b11d0 con 0x7f5df40d0490 2024-08-17T02:27:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc0034e0 con 0x7f5df40d0490 2024-08-17T02:27:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208325546 0 0) 0x7f5ddc0034e0 con 0x7f5df40d0490 2024-08-17T02:27:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5df40b2ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:20.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5df40b2ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 msgr2=0x7f5df40aeeb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 --2- 172.21.15.46:0/2863149676 >> v2:172.21.15.162:3300/0 conn(0x7f5df4159200 0x7f5df40aeeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40b0b80 con 0x7f5df40d0490 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f5de0001470 con 0x7f5df40d0490 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 >> v1:172.21.15.46:6789/0 conn(0x7f5df40d0490 legacy=0x7f5df40ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5ddc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ddc0040d0 0x7f5ddc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ddc004cc0 0x7f5ddc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b0650 con 0x7f5ddc0040d0 2024-08-17T02:27:20.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b08a0 con 0x7f5ddc004cc0 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.497+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc00bc90 con 0x7f5df40ae0d0 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ddc0040d0 0x7f5ddc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ddc004cc0 0x7f5ddc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df9200640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5ddc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 msgr2=0x7f5ddc003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df40ae0d0 0x7f5ddc003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ddc004cc0 msgr2=0x7f5ddc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ddc004cc0 0x7f5ddc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.498+0000 7f5df3e00640 1 -- 172.21.15.46:0/2863149676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0034e0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.499+0000 7f5df3e00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ddc0040d0 0x7f5ddc004780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007fd0 tx=0x7f5df4067280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642cf7bff7c88c80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0031400 con 0x7f5ddc0040d0 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de002d050 con 0x7f5ddc0040d0 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5df3400640 1 -- 172.21.15.46:0/2863149676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00317d0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2863149676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ddc0040d0 msgr2=0x7f5ddc004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5dfbc00640 1 --2- 172.21.15.46:0/2863149676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ddc0040d0 0x7f5ddc004780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5de0007fd0 tx=0x7f5df4067280 comp rx=0 tx=0).stop 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.500+0000 7f5df9c00640 1 -- 172.21.15.46:0/2863149676 reap_dead start 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.501+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2863149676 shutdown_connections 2024-08-17T02:27:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.501+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2863149676 >> 172.21.15.46:0/2863149676 conn(0x7f5df406eb90 msgr2=0x7f5df40cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.501+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2863149676 shutdown_connections 2024-08-17T02:27:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.501+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2863149676 wait complete. 2024-08-17T02:27:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.503+0000 7f5dfbc00640 1 Processor -- start 2024-08-17T02:27:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.503+0000 7f5dfbc00640 1 -- start start 2024-08-17T02:27:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df4153800 0x7f5df40c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 0x7f5df40c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40c5ff0 con 0x7f5df4153c70 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df409a7e0 con 0x7f5df4153800 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.504+0000 7f5dfbc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df4099eb0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:53900/0 (socket says 172.21.15.46:53900) 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 -- 172.21.15.46:0/2490585034 learned_addr learned my addr 172.21.15.46:0/2490585034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df4153800 0x7f5df40c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 0x7f5df40c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 -- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df4153800 msgr2=0x7f5df40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df4153800 0x7f5df40c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 -- 172.21.15.46:0/2490585034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 msgr2=0x7f5df40c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 0x7f5df40c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9200640 1 -- 172.21.15.46:0/2490585034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df409a190 con 0x7f5ddc0040d0 2024-08-17T02:27:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.505+0000 7f5df9c00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 0x7f5df40c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:20.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5df9200640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5de8011760 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800f6a0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800f800 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df409a470 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800fba0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df41691e0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5de8015440 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.506+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5de801a030 con 0x7f5ddc0040d0 2024-08-17T02:27:20.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.507+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df4071050 con 0x7f5ddc0040d0 2024-08-17T02:27:20.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.512+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5de80157e0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.582+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5df40683c0 con 0x7f5ddc0040d0 2024-08-17T02:27:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.587+0000 7f5de7e00640 1 -- 172.21.15.46:0/2490585034 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5de8015980 con 0x7f5ddc0040d0 2024-08-17T02:27:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-08-17T02:27:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 msgr2=0x7f5df4168ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5de8011760 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 shutdown_connections 2024-08-17T02:27:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5df4153c70 0x7f5df40c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df4153800 0x7f5df40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 --2- 172.21.15.46:0/2490585034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ddc0040d0 0x7f5df4168ca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 >> 172.21.15.46:0/2490585034 conn(0x7f5df406eb90 msgr2=0x7f5df4158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 shutdown_connections 2024-08-17T02:27:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:20.588+0000 7f5dfbc00640 1 -- 172.21.15.46:0/2490585034 wait complete. 2024-08-17T02:27:20.605 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:27:20.605 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:20.605 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:27:20.635 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:20.634+0000 7fa1edb6cec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:20.636 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:20.636+0000 7fc474cd3ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:20.661 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:20.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:27:20.757 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:20.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:27:20.789 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:20.788+0000 7fa1edb6cec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:20.796 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:20.795+0000 7fc474cd3ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:20.846 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:20.845+0000 7fa1edb6cec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:20.851 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-08-17T02:27:20.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:27:20.859 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:20.858+0000 7fc474cd3ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:20.915 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:20.915 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:27:20.971 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:20.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:27:21.068 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:21.068 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:27:21.147 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:21.146+0000 7fa1edb6cec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:21.150 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:21.150+0000 7fc474cd3ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:21.164 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-08-17T02:27:21.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:27:21.200 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:21.199+0000 7fa1edb6cec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:21.203 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:21.202+0000 7fc474cd3ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:21.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 39f64227-580b-44c5-a165-190472c6b276 0 2024-08-17T02:27:21.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.441+0000 7f2ef5600640 1 Processor -- start 2024-08-17T02:27:21.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.441+0000 7f2ef5600640 1 -- start start 2024-08-17T02:27:21.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef5600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef5600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00cadc0 con 0x7f2ef0159b90 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef5600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00cb060 con 0x7f2ef0159f60 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef5600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00cb880 con 0x7f2ef00ccca0 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2ef4c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41210/0 (socket says 172.21.15.162:41210) 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.443+0000 7f2ef4c00640 1 -- 172.21.15.162:0/503535127 learned_addr learned my addr 172.21.15.162:0/503535127 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.444 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.442+0000 7f2eef400640 1 --1- 172.21.15.162:0/503535127 >> v1:172.21.15.162:6789/0 conn(0x7f2ef0159f60 0x7f2ef00cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59702/0 (socket says 172.21.15.162:59702) 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.443+0000 7f2ef4c00640 1 -- 172.21.15.162:0/503535127 >> v1:172.21.15.162:6789/0 conn(0x7f2ef0159f60 legacy=0x7f2ef00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.443+0000 7f2ef4c00640 1 -- 172.21.15.162:0/503535127 >> v1:172.21.15.46:6789/0 conn(0x7f2ef0159b90 legacy=0x7f2ef00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.443+0000 7f2ef4c00640 1 -- 172.21.15.162:0/503535127 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00cb300 con 0x7f2ef00ccca0 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.443+0000 7f2eeea00640 1 -- 172.21.15.162:0/503535127 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405222628 0 0) 0x7f2ef00cadc0 con 0x7f2ef0159b90 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.444+0000 7f2ef4c00640 1 --2- 172.21.15.162:0/503535127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f50 tx=0x7f2ee8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2252f26f5e098797 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.444+0000 7f2eeea00640 1 -- 172.21.15.162:0/503535127 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8032450 con 0x7f2ef00ccca0 2024-08-17T02:27:21.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.444+0000 7f2eeea00640 1 -- 172.21.15.162:0/503535127 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80325b0 con 0x7f2ef00ccca0 2024-08-17T02:27:21.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.444+0000 7f2eeea00640 1 -- 172.21.15.162:0/503535127 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8032950 con 0x7f2ef00ccca0 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 -- 172.21.15.162:0/503535127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 msgr2=0x7f2ef0163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 --2- 172.21.15.162:0/503535127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f50 tx=0x7f2ee8009840 comp rx=0 tx=0).stop 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 -- 172.21.15.162:0/503535127 shutdown_connections 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 --2- 172.21.15.162:0/503535127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef0163870 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 -- 172.21.15.162:0/503535127 >> 172.21.15.162:0/503535127 conn(0x7f2ef0098e00 msgr2=0x7f2ef006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 -- 172.21.15.162:0/503535127 shutdown_connections 2024-08-17T02:27:21.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.445+0000 7f2ef5600640 1 -- 172.21.15.162:0/503535127 wait complete. 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.446+0000 7f2ef5600640 1 Processor -- start 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.446+0000 7f2ef5600640 1 -- start start 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef0159b90 0x7f2ef00b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00b48c0 con 0x7f2ef0159b90 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00b5660 con 0x7f2ef0159f60 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef5600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef009ab00 con 0x7f2ef00ccca0 2024-08-17T02:27:21.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2eefe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.447+0000 7f2ef4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2ef4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41986/0 (socket says 172.21.15.162:41986) 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2ef4c00640 1 -- 172.21.15.162:0/3305561756 learned_addr learned my addr 172.21.15.162:0/3305561756 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eef400640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef0159b90 0x7f2ef00b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 -- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 msgr2=0x7f2ef0158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 -- 172.21.15.162:0/3305561756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef0159b90 msgr2=0x7f2ef00b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef0159b90 0x7f2ef00b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 -- 172.21.15.162:0/3305561756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009ae0 con 0x7f2ef00ccca0 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2ef4c00640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2eefe00640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef00b4fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c490 tx=0x7f2ee0007c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.448+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0011590 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee0011710 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0011ad0 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef009ade0 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef009a7b0 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2ee0012420 con 0x7f2ef00ccca0 2024-08-17T02:27:21.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.449+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2ee001c790 con 0x7f2ef00ccca0 2024-08-17T02:27:21.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.450+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef0071050 con 0x7f2ef00ccca0 2024-08-17T02:27:21.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.454+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2ee0021060 con 0x7f2ef00ccca0 2024-08-17T02:27:21.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.530+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "39f64227-580b-44c5-a165-190472c6b276", "id": 0} v 0) v1 -- 0x7f2ef0068e70 con 0x7f2ef00ccca0 2024-08-17T02:27:21.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.535+0000 7f2ee7400640 1 -- 172.21.15.162:0/3305561756 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39f64227-580b-44c5-a165-190472c6b276", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ee0017070 con 0x7f2ef00ccca0 2024-08-17T02:27:21.536 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 msgr2=0x7f2ef00b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef00b4fc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c490 tx=0x7f2ee0007c50 comp rx=0 tx=0).stop 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 shutdown_connections 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef0159f60 0x7f2ef0158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ef0159b90 0x7f2ef00b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 --2- 172.21.15.162:0/3305561756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef00ccca0 0x7f2ef00b4fc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 >> 172.21.15.162:0/3305561756 conn(0x7f2ef0098e00 msgr2=0x7f2ef0157000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 shutdown_connections 2024-08-17T02:27:21.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.536+0000 7f2ef5600640 1 -- 172.21.15.162:0/3305561756 wait complete. 2024-08-17T02:27:21.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ab5fafbd-63f3-4437-b422-3379704e5d8d 1 2024-08-17T02:27:21.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.695+0000 7ff059a00640 1 Processor -- start 2024-08-17T02:27:21.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.696+0000 7ff059a00640 1 -- start start 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0540d09a0 0x7ff0540ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0540cf300 con 0x7ff05415c2f0 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0540cf550 con 0x7ff0540d09a0 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540cf830 con 0x7ff0540cb360 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0540d09a0 0x7ff0540ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff053400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0540d09a0 0x7ff0540ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41998/0 (socket says 172.21.15.162:41998) 2024-08-17T02:27:21.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 -- 172.21.15.162:0/3991899952 learned_addr learned my addr 172.21.15.162:0/3991899952 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 -- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 msgr2=0x7ff0540cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:21.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 -- 172.21.15.162:0/3991899952 >> v1:172.21.15.162:6789/0 conn(0x7ff05415c2f0 legacy=0x7ff0540cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff059000640 1 -- 172.21.15.162:0/3991899952 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0540aceb0 con 0x7ff0540d09a0 2024-08-17T02:27:21.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.697+0000 7ff053400640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:21.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.698+0000 7ff059000640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540ad3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009f20 tx=0x7ff04c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05998feb3342d54 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff052a00640 1 -- 172.21.15.162:0/3991899952 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c031400 con 0x7ff0540d09a0 2024-08-17T02:27:21.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff052a00640 1 -- 172.21.15.162:0/3991899952 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c02d050 con 0x7ff0540d09a0 2024-08-17T02:27:21.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff052a00640 1 -- 172.21.15.162:0/3991899952 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0317d0 con 0x7ff0540d09a0 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 -- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 msgr2=0x7ff0540ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540ad3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009f20 tx=0x7ff04c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 -- 172.21.15.162:0/3991899952 shutdown_connections 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 --2- 172.21.15.162:0/3991899952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540ad3d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 -- 172.21.15.162:0/3991899952 >> 172.21.15.162:0/3991899952 conn(0x7ff0540cfdb0 msgr2=0x7ff0540d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 -- 172.21.15.162:0/3991899952 shutdown_connections 2024-08-17T02:27:21.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.699+0000 7ff059a00640 1 -- 172.21.15.162:0/3991899952 wait complete. 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.701+0000 7ff059a00640 1 Processor -- start 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.701+0000 7ff059a00640 1 -- start start 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 0x7ff0540b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05414ca70 con 0x7ff05415c2f0 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540c7110 con 0x7ff0540d09a0 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0540c6dc0 con 0x7ff0540cb360 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42004/0 (socket says 172.21.15.162:42004) 2024-08-17T02:27:21.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053400640 1 -- 172.21.15.162:0/1079746930 learned_addr learned my addr 172.21.15.162:0/1079746930 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 -- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 msgr2=0x7ff0540b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059000640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 0x7ff0540b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 -- 172.21.15.162:0/1079746930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 msgr2=0x7ff0540b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 0x7ff0540b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053e00640 1 -- 172.21.15.162:0/1079746930 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009390 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff053400640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.702+0000 7ff059000640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 0x7ff0540b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff053e00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540c9840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c410 tx=0x7ff044007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044011590 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440116f0 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c009ae0 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044011ab0 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0540b2080 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff04401c440 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.703+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff0440127e0 con 0x7ff0540cb360 2024-08-17T02:27:21.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.704+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff054071050 con 0x7ff0540cb360 2024-08-17T02:27:21.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.706+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff044017070 con 0x7ff0540cb360 2024-08-17T02:27:21.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.782+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ab5fafbd-63f3-4437-b422-3379704e5d8d", "id": 1} v 0) v1 -- 0x7ff0540c6900 con 0x7ff0540cb360 2024-08-17T02:27:21.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.786+0000 7ff04b400640 1 -- 172.21.15.162:0/1079746930 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab5fafbd-63f3-4437-b422-3379704e5d8d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff04401c8d0 con 0x7ff0540cb360 2024-08-17T02:27:21.787 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 msgr2=0x7ff0540c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540c9840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c410 tx=0x7ff044007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 shutdown_connections 2024-08-17T02:27:21.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff05415c2f0 0x7ff0540b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0540d09a0 0x7ff0540b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 --2- 172.21.15.162:0/1079746930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0540cb360 0x7ff0540c9840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 >> 172.21.15.162:0/1079746930 conn(0x7ff0540cfdb0 msgr2=0x7ff054067540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 shutdown_connections 2024-08-17T02:27:21.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.787+0000 7ff059a00640 1 -- 172.21.15.162:0/1079746930 wait complete. 2024-08-17T02:27:21.804 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new fd0b2639-63af-44a9-ad7f-61b338f6aeee 2 2024-08-17T02:27:21.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.948+0000 7f02bf200640 1 Processor -- start 2024-08-17T02:27:21.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.948+0000 7f02bf200640 1 -- start start 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bf200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02c0159e70 0x7f02c00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bf200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c00cad60 con 0x7f02c015a2c0 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bf200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00c4b90 con 0x7f02c0159e70 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00ce630 con 0x7f02c0159aa0 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.949+0000 7f02bde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02c0159e70 0x7f02c00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.951 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:40172/0 (socket says 172.21.15.162:40172) 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bde00640 1 -- 172.21.15.162:0/538361122 learned_addr learned my addr 172.21.15.162:0/538361122 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bd400640 1 -- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 msgr2=0x7f02c00ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bd400640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bd400640 1 -- 172.21.15.162:0/538361122 >> v1:172.21.15.46:6789/0 conn(0x7f02c015a2c0 legacy=0x7f02c00cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bd400640 1 -- 172.21.15.162:0/538361122 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00ce910 con 0x7f02c0159e70 2024-08-17T02:27:21.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.950+0000 7f02bde00640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.951+0000 7f02bd400640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c00cc7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009850 tx=0x7f02ac0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fae0f063a031ab7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.951+0000 7f02bca00640 1 -- 172.21.15.162:0/538361122 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac02ad90 con 0x7f02c0159e70 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.951+0000 7f02bca00640 1 -- 172.21.15.162:0/538361122 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac032440 con 0x7f02c0159e70 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.951+0000 7f02bca00640 1 -- 172.21.15.162:0/538361122 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac032820 con 0x7f02c0159e70 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 -- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 msgr2=0x7f02c00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c00cc7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009850 tx=0x7f02ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 -- 172.21.15.162:0/538361122 shutdown_connections 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c00cc7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 --2- 172.21.15.162:0/538361122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c00ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 -- 172.21.15.162:0/538361122 >> 172.21.15.162:0/538361122 conn(0x7f02c0099040 msgr2=0x7f02c006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 -- 172.21.15.162:0/538361122 shutdown_connections 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.952+0000 7f02bf200640 1 -- 172.21.15.162:0/538361122 wait complete. 2024-08-17T02:27:21.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.953+0000 7f02bf200640 1 Processor -- start 2024-08-17T02:27:21.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.953+0000 7f02bf200640 1 -- start start 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c0142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c0157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02c015a2c0 0x7f02c01582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00b3460 con 0x7f02c015a2c0 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00b3a20 con 0x7f02c0159e70 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01588a0 con 0x7f02c0159aa0 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c0142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.954+0000 7f02bd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c0157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bde00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c0142910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:40188/0 (socket says 172.21.15.162:40188) 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bde00640 1 -- 172.21.15.162:0/2839500654 learned_addr learned my addr 172.21.15.162:0/2839500654 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:21.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02be800640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02c015a2c0 0x7f02c01582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 -- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 msgr2=0x7f02c0142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c0142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 -- 172.21.15.162:0/2839500654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02c015a2c0 msgr2=0x7f02c01582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02c015a2c0 0x7f02c01582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 -- 172.21.15.162:0/2839500654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b0009450 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02bd400640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c0157d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f02ac031000 tx=0x7f02ac032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac000d10 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac031a60 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.955+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac031e60 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.956+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac009390 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.956+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c00b36b0 con 0x7f02c0159e70 2024-08-17T02:27:21.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.956+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f02ac043030 con 0x7f02c0159e70 2024-08-17T02:27:21.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.956+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f02ac041070 con 0x7f02c0159e70 2024-08-17T02:27:21.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.957+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c00b3b90 con 0x7f02c0159e70 2024-08-17T02:27:21.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:21.959+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f02ac0657a0 con 0x7f02c0159e70 2024-08-17T02:27:22.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.033+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd0b2639-63af-44a9-ad7f-61b338f6aeee", "id": 2} v 0) v1 -- 0x7f02c0071050 con 0x7f02c0159e70 2024-08-17T02:27:22.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.037+0000 7f02b5600640 1 -- 172.21.15.162:0/2839500654 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd0b2639-63af-44a9-ad7f-61b338f6aeee", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f02ac054070 con 0x7f02c0159e70 2024-08-17T02:27:22.038 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 msgr2=0x7f02c0157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c0157d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f02ac031000 tx=0x7f02ac032000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 shutdown_connections 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02c015a2c0 0x7f02c01582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02c0159e70 0x7f02c0157d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 --2- 172.21.15.162:0/2839500654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02c0159aa0 0x7f02c0142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 >> 172.21.15.162:0/2839500654 conn(0x7f02c0099040 msgr2=0x7f02c0067e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 shutdown_connections 2024-08-17T02:27:22.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.038+0000 7f02bf200640 1 -- 172.21.15.162:0/2839500654 wait complete. 2024-08-17T02:27:22.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new d45b8fab-8a00-4831-a8aa-14dcded49d30 3 2024-08-17T02:27:22.056 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.056+0000 7fc474cd3ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:22.080 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.079+0000 7fa1edb6cec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:22.158 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.157+0000 7fc474cd3ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:22.184 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.183+0000 7fa1edb6cec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:22.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.198+0000 7f9bde200640 1 Processor -- start 2024-08-17T02:27:22.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.198+0000 7f9bde200640 1 -- start start 2024-08-17T02:27:22.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bde200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9bd80ca2f0 0x7f9bd80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bde200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 0x7f9bd80c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bde200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd806f240 con 0x7f9bd8158ea0 2024-08-17T02:27:22.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bde200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80c6f20 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bde200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80cacb0 con 0x7f9bd80c7370 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bd7400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9bd8158ea0 0x7f9bd80d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59350/0 (socket says 172.21.15.162:59350) 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bd7400640 1 -- 172.21.15.162:0/3073728474 learned_addr learned my addr 172.21.15.162:0/3073728474 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.199+0000 7f9bd7e00640 1 --2- 172.21.15.162:0/3073728474 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 0x7f9bd80c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/3073728474 >> v2:172.21.15.46:3300/0 conn(0x7f9bd80ca2f0 0x7f9bd80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6000640 1 -- 172.21.15.162:0/3073728474 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707948378 0 0) 0x7f9bd806f240 con 0x7f9bd8158ea0 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6000640 1 -- 172.21.15.162:0/3073728474 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc0034e0 con 0x7f9bd8158ea0 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6a00640 1 -- 172.21.15.162:0/3073728474 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 msgr2=0x7f9bd80c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/3073728474 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 0x7f9bd80c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6a00640 1 -- 172.21.15.162:0/3073728474 >> v1:172.21.15.162:6789/0 conn(0x7f9bd8158ea0 legacy=0x7f9bd80d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd6a00640 1 -- 172.21.15.162:0/3073728474 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80cf410 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.204 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.200+0000 7f9bd7e00640 1 --2- 172.21.15.162:0/3073728474 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 0x7f9bd80c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.201+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/3073728474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80ca2f0 0x7f9bd80ca770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8069bb0 tx=0x7f9bc40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8fd490315ce563 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.201+0000 7f9bd6000640 1 -- 172.21.15.162:0/3073728474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc402ad20 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.201+0000 7f9bd6000640 1 -- 172.21.15.162:0/3073728474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc402ae80 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.201+0000 7f9bd6000640 1 -- 172.21.15.162:0/3073728474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4032670 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 -- 172.21.15.162:0/3073728474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80ca2f0 msgr2=0x7f9bd80ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 --2- 172.21.15.162:0/3073728474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80ca2f0 0x7f9bd80ca770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8069bb0 tx=0x7f9bc40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 -- 172.21.15.162:0/3073728474 shutdown_connections 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 --2- 172.21.15.162:0/3073728474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80ca2f0 0x7f9bd80ca770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 --2- 172.21.15.162:0/3073728474 >> v2:172.21.15.162:3300/0 conn(0x7f9bd80c7370 0x7f9bd80c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 -- 172.21.15.162:0/3073728474 >> 172.21.15.162:0/3073728474 conn(0x7f9bd806eb90 msgr2=0x7f9bd80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 -- 172.21.15.162:0/3073728474 shutdown_connections 2024-08-17T02:27:22.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.202+0000 7f9bde200640 1 -- 172.21.15.162:0/3073728474 wait complete. 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.204+0000 7f9bde200640 1 Processor -- start 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.204+0000 7f9bde200640 1 -- start start 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.204+0000 7f9bde200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80c7370 0x7f9bd80c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.204+0000 7f9bde200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bde200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 0x7f9bd814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bde200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809a4e0 con 0x7f9bd80c7370 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bde200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809a7c0 con 0x7f9bd8158ea0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bde200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd809aaa0 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 0x7f9bd814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:40198/0 (socket says 172.21.15.162:40198) 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 -- 172.21.15.162:0/769536393 learned_addr learned my addr 172.21.15.162:0/769536393 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd7400640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80c7370 0x7f9bd80c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 -- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 msgr2=0x7f9bd814a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 0x7f9bd814a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 -- 172.21.15.162:0/769536393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80c7370 msgr2=0x7f9bd80c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80c7370 0x7f9bd80c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd6a00640 1 -- 172.21.15.162:0/769536393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009a20 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.205+0000 7f9bd7e00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 0x7f9bd814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bd6a00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009360 tx=0x7f9bc4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc403b6e0 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc403b840 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc403bc00 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bde200640 1 -- 172.21.15.162:0/769536393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc4009390 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bde200640 1 -- 172.21.15.162:0/769536393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd809b060 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9bc4043030 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.206+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9bc4041070 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.211 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.207+0000 7fc474cd3ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.208+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac005210 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.210+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9bc404b060 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.252 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.251+0000 7fa1edb6cec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:22.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.307+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d45b8fab-8a00-4831-a8aa-14dcded49d30", "id": 3} v 0) v1 -- 0x7f9bac005500 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.311+0000 7f9bcea00640 1 -- 172.21.15.162:0/769536393 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d45b8fab-8a00-4831-a8aa-14dcded49d30", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bc40540b0 con 0x7f9bd80ca2f0 2024-08-17T02:27:22.312 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.312+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 msgr2=0x7f9bd809cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.312+0000 7f9bc3e00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4009360 tx=0x7f9bc4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.312+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 shutdown_connections 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.312+0000 7f9bc3e00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bd8158ea0 0x7f9bd814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.312+0000 7f9bc3e00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9bd80ca2f0 0x7f9bd809cb30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.313+0000 7f9bc3e00640 1 --2- 172.21.15.162:0/769536393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bd80c7370 0x7f9bd80c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.313+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 >> 172.21.15.162:0/769536393 conn(0x7f9bd806eb90 msgr2=0x7f9bd8068c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.313+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 shutdown_connections 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.313+0000 7f9bc3e00640 1 -- 172.21.15.162:0/769536393 wait complete. 2024-08-17T02:27:22.327 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 74a43019-e173-4f34-8207-f65ac3f1c6d4 4 2024-08-17T02:27:22.383 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.382+0000 7fc474cd3ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:22.431 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.430+0000 7fa1edb6cec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:22.439 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.439+0000 7fc474cd3ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:22.493 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.491+0000 7fa1edb6cec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:22.503 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.502+0000 7fc474cd3ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:22.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.512+0000 7f9c3b200640 1 Processor -- start 2024-08-17T02:27:22.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.513+0000 7f9c3b200640 1 -- start start 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 0x7f9c3c0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c3b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0cad60 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c3b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0c4b90 con 0x7f9c3c159aa0 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0cd1b0 con 0x7f9c3c0ce050 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c39e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9c3c159aa0 0x7f9c3c159e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59364/0 (socket says 172.21.15.162:59364) 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c39400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 0x7f9c3c0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.514+0000 7f9c39e00640 1 -- 172.21.15.162:0/3538733758 learned_addr learned my addr 172.21.15.162:0/3538733758 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-17T02:27:22.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.515+0000 7f9c39400640 1 -- 172.21.15.162:0/3538733758 >> v1:172.21.15.162:6789/0 conn(0x7f9c3c159aa0 legacy=0x7f9c3c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.515+0000 7f9c38a00640 1 -- 172.21.15.162:0/3538733758 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469259688 0 0) 0x7f9c3c0c4b90 con 0x7f9c3c159aa0 2024-08-17T02:27:22.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.515+0000 7f9c39400640 1 -- 172.21.15.162:0/3538733758 >> v1:172.21.15.46:6789/0 conn(0x7f9c3c0ccd30 legacy=0x7f9c3c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.515+0000 7f9c39400640 1 -- 172.21.15.162:0/3538733758 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c15a580 con 0x7f9c3c0ce050 2024-08-17T02:27:22.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.516+0000 7f9c39400640 1 --2- 172.21.15.162:0/3538733758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 0x7f9c3c0cc7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009880 tx=0x7f9c280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e880a3ac88f455fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c38a00640 1 -- 172.21.15.162:0/3538733758 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2802ac40 con 0x7f9c3c0ce050 2024-08-17T02:27:22.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c38a00640 1 -- 172.21.15.162:0/3538733758 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2802ada0 con 0x7f9c3c0ce050 2024-08-17T02:27:22.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c38a00640 1 -- 172.21.15.162:0/3538733758 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28032670 con 0x7f9c3c0ce050 2024-08-17T02:27:22.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c3b200640 1 -- 172.21.15.162:0/3538733758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 msgr2=0x7f9c3c0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3538733758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 0x7f9c3c0cc7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009880 tx=0x7f9c280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c3b200640 1 -- 172.21.15.162:0/3538733758 shutdown_connections 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3538733758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ce050 0x7f9c3c0cc7f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.517+0000 7f9c3b200640 1 -- 172.21.15.162:0/3538733758 >> 172.21.15.162:0/3538733758 conn(0x7f9c3c099040 msgr2=0x7f9c3c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.518+0000 7f9c3b200640 1 -- 172.21.15.162:0/3538733758 shutdown_connections 2024-08-17T02:27:22.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.518+0000 7f9c3b200640 1 -- 172.21.15.162:0/3538733758 wait complete. 2024-08-17T02:27:22.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.519+0000 7f9c3b200640 1 Processor -- start 2024-08-17T02:27:22.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.519+0000 7f9c3b200640 1 -- start start 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c3c0ce050 0x7f9c3c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c3c159aa0 0x7f9c3c09b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c09a380 con 0x7f9c3c159aa0 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b5a10 con 0x7f9c3c0ce050 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c099a50 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c39e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c39e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:40218/0 (socket says 172.21.15.162:40218) 2024-08-17T02:27:22.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c39e00640 1 -- 172.21.15.162:0/3908371975 learned_addr learned my addr 172.21.15.162:0/3908371975 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c39400640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c3c0ce050 0x7f9c3c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.520+0000 7f9c3a800640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c3c159aa0 0x7f9c3c09b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 -- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c3c0ce050 msgr2=0x7f9c3c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c3c0ce050 0x7f9c3c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 -- 172.21.15.162:0/3908371975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c3c159aa0 msgr2=0x7f9c3c09b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c3c159aa0 0x7f9c3c09b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 -- 172.21.15.162:0/3908371975 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009390 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c39e00640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c5e0 tx=0x7f9c2c007dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c005aa0 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c005c20 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c099d30 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c007340 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.521+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c156120 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.522+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9c2c01b400 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.522+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9c2c005e10 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.522+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c071050 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.524+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9c2c01b6b0 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.557 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.557+0000 7fa1edb6cec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:22.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.598+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74a43019-e173-4f34-8207-f65ac3f1c6d4", "id": 4} v 0) v1 -- 0x7f9c3c06f480 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.603+0000 7f9c31600640 1 -- 172.21.15.162:0/3908371975 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74a43019-e173-4f34-8207-f65ac3f1c6d4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c2c02a0b0 con 0x7f9c3c0ccd30 2024-08-17T02:27:22.604 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.603+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 msgr2=0x7f9c3c0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.603+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c5e0 tx=0x7f9c2c007dc0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 shutdown_connections 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9c3c159aa0 0x7f9c3c09b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c3c0ce050 0x7f9c3c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 --2- 172.21.15.162:0/3908371975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c3c0ccd30 0x7f9c3c0b5430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 >> 172.21.15.162:0/3908371975 conn(0x7f9c3c099040 msgr2=0x7f9c3c067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 shutdown_connections 2024-08-17T02:27:22.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.604+0000 7f9c3b200640 1 -- 172.21.15.162:0/3908371975 wait complete. 2024-08-17T02:27:22.615 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:22.615+0000 7fc474cd3ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:22.619 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new b39293a8-0765-4a1f-a686-ac594d9b771a 5 2024-08-17T02:27:22.672 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:22.671+0000 7fa1edb6cec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:22.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.763+0000 7f090ea00640 1 Processor -- start 2024-08-17T02:27:22.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.763+0000 7f090ea00640 1 -- start start 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f09080adec0 0x7f0908161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ea00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090815b030 con 0x7f0908156990 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09080cc2e0 con 0x7f0908156d60 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09080af950 con 0x7f09080adec0 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f0907400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0908156d60 0x7f09080ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59378/0 (socket says 172.21.15.162:59378) 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f0907400640 1 -- 172.21.15.162:0/2447422702 learned_addr learned my addr 172.21.15.162:0/2447422702 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-17T02:27:22.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ca00640 1 --2- 172.21.15.162:0/2447422702 >> v2:172.21.15.162:3300/0 conn(0x7f09080adec0 0x7f0908161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f0906a00640 1 -- 172.21.15.162:0/2447422702 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185710276 0 0) 0x7f09080cc2e0 con 0x7f0908156d60 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ca00640 1 -- 172.21.15.162:0/2447422702 >> v1:172.21.15.162:6789/0 conn(0x7f0908156d60 legacy=0x7f09080ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ca00640 1 -- 172.21.15.162:0/2447422702 >> v1:172.21.15.46:6789/0 conn(0x7f0908156990 legacy=0x7f09080b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.765+0000 7f090ca00640 1 -- 172.21.15.162:0/2447422702 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09080b1110 con 0x7f09080adec0 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.767+0000 7f090ca00640 1 --2- 172.21.15.162:0/2447422702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09080adec0 0x7f0908161890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0900009e60 tx=0x7f0900009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6092ce3809f7ef7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.767+0000 7f0906a00640 1 -- 172.21.15.162:0/2447422702 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900007550 con 0x7f09080adec0 2024-08-17T02:27:22.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.767+0000 7f0906a00640 1 -- 172.21.15.162:0/2447422702 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090002d050 con 0x7f09080adec0 2024-08-17T02:27:22.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.767+0000 7f0906a00640 1 -- 172.21.15.162:0/2447422702 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000078e0 con 0x7f09080adec0 2024-08-17T02:27:22.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 -- 172.21.15.162:0/2447422702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09080adec0 msgr2=0x7f0908161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 --2- 172.21.15.162:0/2447422702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09080adec0 0x7f0908161890 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0900009e60 tx=0x7f0900009780 comp rx=0 tx=0).stop 2024-08-17T02:27:22.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 -- 172.21.15.162:0/2447422702 shutdown_connections 2024-08-17T02:27:22.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 --2- 172.21.15.162:0/2447422702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09080adec0 0x7f0908161890 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 -- 172.21.15.162:0/2447422702 >> 172.21.15.162:0/2447422702 conn(0x7f0908067750 msgr2=0x7f09080cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 -- 172.21.15.162:0/2447422702 shutdown_connections 2024-08-17T02:27:22.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.768+0000 7f090ea00640 1 -- 172.21.15.162:0/2447422702 wait complete. 2024-08-17T02:27:22.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.769+0000 7f090ea00640 1 Processor -- start 2024-08-17T02:27:22.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.769+0000 7f090ea00640 1 -- start start 2024-08-17T02:27:22.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 0x7f0908151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 0x7f0908158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 0x7f09081585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908158c20 con 0x7f0908156990 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908158f00 con 0x7f0908156d60 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.770+0000 7f090ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09081591e0 con 0x7f09080adec0 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 0x7f0908151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f090ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 0x7f09081585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 0x7f0908158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 0x7f0908151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:40220/0 (socket says 172.21.15.162:40220) 2024-08-17T02:27:22.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907e00640 1 -- 172.21.15.162:0/6252491 learned_addr learned my addr 172.21.15.162:0/6252491 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 -- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 msgr2=0x7f0908151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 0x7f0908151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 -- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 msgr2=0x7f09081585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 0x7f09081585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 -- 172.21.15.162:0/6252491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009a20 con 0x7f0908156990 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f090ca00640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 0x7f09081585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:22.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.771+0000 7f0907400640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 0x7f0908158080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c410 tx=0x7f08f4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4005aa0 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4005c00 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40070d0 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09081594c0 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908069a50 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f08f4007520 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.772+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f08f4012980 con 0x7f0908156990 2024-08-17T02:27:22.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.773+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09081599c0 con 0x7f0908156990 2024-08-17T02:27:22.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.776+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f08f4017070 con 0x7f0908156990 2024-08-17T02:27:22.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.848+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b39293a8-0765-4a1f-a686-ac594d9b771a", "id": 5} v 0) v1 -- 0x7f0908071050 con 0x7f0908156990 2024-08-17T02:27:22.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.852+0000 7f08ff400640 1 -- 172.21.15.162:0/6252491 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b39293a8-0765-4a1f-a686-ac594d9b771a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08f401c500 con 0x7f0908156990 2024-08-17T02:27:22.853 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.852+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 msgr2=0x7f0908158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.852+0000 7f090ea00640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 0x7f0908158080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c410 tx=0x7f08f4007ea0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 shutdown_connections 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0908156d60 0x7f09081585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0908156990 0x7f0908158080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 --2- 172.21.15.162:0/6252491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09080adec0 0x7f0908151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 >> 172.21.15.162:0/6252491 conn(0x7f0908067750 msgr2=0x7f09081525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:22.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 shutdown_connections 2024-08-17T02:27:22.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:22.853+0000 7f090ea00640 1 -- 172.21.15.162:0/6252491 wait complete. 2024-08-17T02:27:22.867 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26 6 2024-08-17T02:27:23.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.014+0000 7f945d200640 1 Processor -- start 2024-08-17T02:27:23.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.014+0000 7f945d200640 1 -- start start 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f945d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f94580ccca0 0x7f9458163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f945d200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580cadc0 con 0x7f9458159f60 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f945d200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94580cb060 con 0x7f9458159b90 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f945d200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94580cb880 con 0x7f94580ccca0 2024-08-17T02:27:23.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f9457400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9458159b90 0x7f94580ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59386/0 (socket says 172.21.15.162:59386) 2024-08-17T02:27:23.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f9457400640 1 -- 172.21.15.162:0/649194075 learned_addr learned my addr 172.21.15.162:0/649194075 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-17T02:27:23.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.015+0000 7f9457e00640 1 --2- 172.21.15.162:0/649194075 >> v2:172.21.15.162:3300/0 conn(0x7f94580ccca0 0x7f9458163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.016+0000 7f9457e00640 1 -- 172.21.15.162:0/649194075 >> v1:172.21.15.162:6789/0 conn(0x7f9458159b90 legacy=0x7f94580ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.016+0000 7f9457e00640 1 -- 172.21.15.162:0/649194075 >> v1:172.21.15.46:6789/0 conn(0x7f9458159f60 legacy=0x7f94580cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.016+0000 7f9457e00640 1 -- 172.21.15.162:0/649194075 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580cb300 con 0x7f94580ccca0 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.016+0000 7f9456000640 1 -- 172.21.15.162:0/649194075 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076490190 0 0) 0x7f94580cadc0 con 0x7f9458159f60 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.017+0000 7f9457e00640 1 --2- 172.21.15.162:0/649194075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f9458163870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9450009e60 tx=0x7f9450009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd21e62da499348e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.017+0000 7f9456000640 1 -- 172.21.15.162:0/649194075 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450007550 con 0x7f94580ccca0 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.017+0000 7f9456000640 1 -- 172.21.15.162:0/649194075 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945002d050 con 0x7f94580ccca0 2024-08-17T02:27:23.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.017+0000 7f9456000640 1 -- 172.21.15.162:0/649194075 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450007900 con 0x7f94580ccca0 2024-08-17T02:27:23.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 -- 172.21.15.162:0/649194075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 msgr2=0x7f9458163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 --2- 172.21.15.162:0/649194075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f9458163870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9450009e60 tx=0x7f9450009780 comp rx=0 tx=0).stop 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 -- 172.21.15.162:0/649194075 shutdown_connections 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 --2- 172.21.15.162:0/649194075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f9458163870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 -- 172.21.15.162:0/649194075 >> 172.21.15.162:0/649194075 conn(0x7f9458098e00 msgr2=0x7f945806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 -- 172.21.15.162:0/649194075 shutdown_connections 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.018+0000 7f945d200640 1 -- 172.21.15.162:0/649194075 wait complete. 2024-08-17T02:27:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.019+0000 7f945d200640 1 Processor -- start 2024-08-17T02:27:23.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.019+0000 7f945d200640 1 -- start start 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9458159b90 0x7f94580b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9458159f60 0x7f94580b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9458168b10 con 0x7f9458159f60 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94580c3a00 con 0x7f94580ccca0 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f945d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945816c530 con 0x7f9458159b90 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f9457400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f9456a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9458159b90 0x7f94580b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f9457400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56146/0 (socket says 172.21.15.162:56146) 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f9457400640 1 -- 172.21.15.162:0/1350782370 learned_addr learned my addr 172.21.15.162:0/1350782370 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.020+0000 7f9457e00640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9458159f60 0x7f94580b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 -- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9458159b90 msgr2=0x7f94580b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9458159b90 0x7f94580b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 -- 172.21.15.162:0/1350782370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9458159f60 msgr2=0x7f94580b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9458159f60 0x7f94580b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 -- 172.21.15.162:0/1350782370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450009a20 con 0x7f94580ccca0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f9457400640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f944800c590 tx=0x7f9448007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9448005aa0 con 0x7f94580ccca0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9448005c20 con 0x7f94580ccca0 2024-08-17T02:27:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945816c810 con 0x7f94580ccca0 2024-08-17T02:27:23.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.021+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94480070d0 con 0x7f94580ccca0 2024-08-17T02:27:23.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.022+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945816cdd0 con 0x7f94580ccca0 2024-08-17T02:27:23.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.022+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f94480074a0 con 0x7f94580ccca0 2024-08-17T02:27:23.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.022+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f944801c440 con 0x7f94580ccca0 2024-08-17T02:27:23.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.023+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9458071050 con 0x7f94580ccca0 2024-08-17T02:27:23.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.025+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f9448017070 con 0x7f94580ccca0 2024-08-17T02:27:23.086 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.086+0000 7fc474cd3ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:23.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.099+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26", "id": 6} v 0) v1 -- 0x7f945806ef10 con 0x7f94580ccca0 2024-08-17T02:27:23.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.103+0000 7f944ea00640 1 -- 172.21.15.162:0/1350782370 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f944801ca30 con 0x7f94580ccca0 2024-08-17T02:27:23.105 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-08-17T02:27:23.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.104+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 msgr2=0x7f94580c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.104+0000 7f945d200640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f944800c590 tx=0x7f9448007ea0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 shutdown_connections 2024-08-17T02:27:23.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9458159f60 0x7f94580b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9458159b90 0x7f94580b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 --2- 172.21.15.162:0/1350782370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94580ccca0 0x7f94580c49d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 >> 172.21.15.162:0/1350782370 conn(0x7f9458098e00 msgr2=0x7f9458157680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 shutdown_connections 2024-08-17T02:27:23.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.105+0000 7f945d200640 1 -- 172.21.15.162:0/1350782370 wait complete. 2024-08-17T02:27:23.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 52c858f0-20c2-49ec-85aa-fc3aac957fcf 7 2024-08-17T02:27:23.149 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.148+0000 7fa1edb6cec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:23.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.264+0000 7f038fe00640 1 Processor -- start 2024-08-17T02:27:23.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.264+0000 7f038fe00640 1 -- start start 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03900ccca0 0x7f0390163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038fe00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900cadc0 con 0x7f0390159f60 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038fe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900cb060 con 0x7f0390159b90 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900cb880 con 0x7f03900ccca0 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038ea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0390159b90 0x7f03900ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59396/0 (socket says 172.21.15.162:59396) 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038ea00640 1 -- 172.21.15.162:0/3685175894 learned_addr learned my addr 172.21.15.162:0/3685175894 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-08-17T02:27:23.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038f400640 1 --2- 172.21.15.162:0/3685175894 >> v2:172.21.15.162:3300/0 conn(0x7f03900ccca0 0x7f0390163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727631303 0 0) 0x7f03900cb060 con 0x7f0390159b90 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03740034e0 con 0x7f0390159b90 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891521753 0 0) 0x7f03900cadc0 con 0x7f0390159f60 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03900cb060 con 0x7f0390159f60 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038f400640 1 -- 172.21.15.162:0/3685175894 >> v1:172.21.15.162:6789/0 conn(0x7f0390159b90 legacy=0x7f03900ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038f400640 1 -- 172.21.15.162:0/3685175894 >> v1:172.21.15.46:6789/0 conn(0x7f0390159f60 legacy=0x7f03900cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.266+0000 7f038f400640 1 -- 172.21.15.162:0/3685175894 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900cb300 con 0x7f03900ccca0 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038f400640 1 --2- 172.21.15.162:0/3685175894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f0390163870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0388009e60 tx=0x7f0388009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438765d6ce417f5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388007550 con 0x7f03900ccca0 2024-08-17T02:27:23.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038802d050 con 0x7f03900ccca0 2024-08-17T02:27:23.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038d600640 1 -- 172.21.15.162:0/3685175894 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03880078c0 con 0x7f03900ccca0 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038fe00640 1 -- 172.21.15.162:0/3685175894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 msgr2=0x7f0390163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038fe00640 1 --2- 172.21.15.162:0/3685175894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f0390163870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0388009e60 tx=0x7f0388009780 comp rx=0 tx=0).stop 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.268+0000 7f038fe00640 1 -- 172.21.15.162:0/3685175894 shutdown_connections 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.269+0000 7f038fe00640 1 --2- 172.21.15.162:0/3685175894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f0390163870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.269+0000 7f038fe00640 1 -- 172.21.15.162:0/3685175894 >> 172.21.15.162:0/3685175894 conn(0x7f0390098e00 msgr2=0x7f039006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.269+0000 7f038fe00640 1 -- 172.21.15.162:0/3685175894 shutdown_connections 2024-08-17T02:27:23.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.269+0000 7f038fe00640 1 -- 172.21.15.162:0/3685175894 wait complete. 2024-08-17T02:27:23.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.270+0000 7f038fe00640 1 Processor -- start 2024-08-17T02:27:23.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.270+0000 7f038fe00640 1 -- start start 2024-08-17T02:27:23.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390159b90 0x7f039016bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390159f60 0x7f03901537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c6170 con 0x7f0390159f60 2024-08-17T02:27:23.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900b5280 con 0x7f03900ccca0 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038fe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c5560 con 0x7f0390159b90 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56164/0 (socket says 172.21.15.162:56164) 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038ea00640 1 -- 172.21.15.162:0/1377727718 learned_addr learned my addr 172.21.15.162:0/1377727718 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038e000640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390159b90 0x7f039016bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.271+0000 7f038f400640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390159f60 0x7f03901537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 -- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390159b90 msgr2=0x7f039016bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390159b90 0x7f039016bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 -- 172.21.15.162:0/1377727718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390159f60 msgr2=0x7f03901537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390159f60 0x7f03901537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 -- 172.21.15.162:0/1377727718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388009a20 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038ea00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0380005840 tx=0x7f0380007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380005aa0 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380005c00 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03900c5840 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.272+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800070f0 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.273+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900c5e00 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.273+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f03800074e0 con 0x7f03900ccca0 2024-08-17T02:27:23.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.273+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f038001b400 con 0x7f03900ccca0 2024-08-17T02:27:23.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.274+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390071050 con 0x7f03900ccca0 2024-08-17T02:27:23.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.276+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0380025480 con 0x7f03900ccca0 2024-08-17T02:27:23.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.351+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52c858f0-20c2-49ec-85aa-fc3aac957fcf", "id": 7} v 0) v1 -- 0x7f0390157bb0 con 0x7f03900ccca0 2024-08-17T02:27:23.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.355+0000 7f0386000640 1 -- 172.21.15.162:0/1377727718 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52c858f0-20c2-49ec-85aa-fc3aac957fcf", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f038001b9f0 con 0x7f03900ccca0 2024-08-17T02:27:23.356 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-08-17T02:27:23.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 msgr2=0x7f03900c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0380005840 tx=0x7f0380007df0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 shutdown_connections 2024-08-17T02:27:23.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0390159f60 0x7f03901537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390159b90 0x7f039016bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 --2- 172.21.15.162:0/1377727718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03900ccca0 0x7f03900c4e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 >> 172.21.15.162:0/1377727718 conn(0x7f0390098e00 msgr2=0x7f0390155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 shutdown_connections 2024-08-17T02:27:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-08-17T02:27:23.356+0000 7f038fe00640 1 -- 172.21.15.162:0/1377727718 wait complete. 2024-08-17T02:27:23.367 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.366+0000 7fc474cd3ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:23.372 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:27:23.372 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:27:23.376 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:27:23.376 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:27:23.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:27:23.379 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:27:23.379 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:27:23.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:27:23.383 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:27:23.383 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:27:23.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:27:23.390 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:27:23.390 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:27:23.390 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:27:23.415 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:27:23.416 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:27:23.416 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:27:23.419 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:27:23.419 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:27:23.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:27:23.423 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:27:23.423 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:27:23.423 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:27:23.428 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:27:23.429 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:23.436 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.435+0000 7fa1edb6cec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:23.441 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.440+0000 7fc474cd3ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:23.517 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.516+0000 7fa1edb6cec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:23.595 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.595+0000 7fc474cd3ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.617+0000 7fe3c1400640 1 Processor -- start 2024-08-17T02:27:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.617+0000 7fe3c1400640 1 -- start start 2024-08-17T02:27:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3c1400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3c1400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3c1400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3bc0d0ab0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3c1400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3bc0b00c0 con 0x7fe3bc0ada10 2024-08-17T02:27:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3c1400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0b0360 con 0x7fe3bc0b1120 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.618+0000 7fe3ba800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3bb200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe3bc0b36e0 0x7fe3bc0adde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60418/0 (socket says 172.21.15.46:60418) 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3ba800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45376/0 (socket says 172.21.15.46:45376) 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3bb200640 1 -- 172.21.15.46:0/3206133921 learned_addr learned my addr 172.21.15.46:0/3206133921 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3b9e00640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3ba800640 1 -- 172.21.15.46:0/3206133921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 msgr2=0x7fe3bc0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3ba800640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3ba800640 1 -- 172.21.15.46:0/3206133921 >> v1:172.21.15.46:6789/0 conn(0x7fe3bc0b36e0 legacy=0x7fe3bc0adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.619+0000 7fe3ba800640 1 -- 172.21.15.46:0/3206133921 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0b0640 con 0x7fe3bc0ada10 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.620+0000 7fe3ba800640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009850 tx=0x7fe3ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555ddd59b568682e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.620+0000 7fe3b9400640 1 -- 172.21.15.46:0/3206133921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac02ad90 con 0x7fe3bc0ada10 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.620+0000 7fe3b9400640 1 -- 172.21.15.46:0/3206133921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac032440 con 0x7fe3bc0ada10 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.620+0000 7fe3b9400640 1 -- 172.21.15.46:0/3206133921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac032820 con 0x7fe3bc0ada10 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 -- 172.21.15.46:0/3206133921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0ada10 msgr2=0x7fe3bc0b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac009850 tx=0x7fe3ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 -- 172.21.15.46:0/3206133921 shutdown_connections 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 --2- 172.21.15.46:0/3206133921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc0b2c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 -- 172.21.15.46:0/3206133921 >> 172.21.15.46:0/3206133921 conn(0x7fe3bc0cfdf0 msgr2=0x7fe3bc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 -- 172.21.15.46:0/3206133921 shutdown_connections 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.621+0000 7fe3c1400640 1 -- 172.21.15.46:0/3206133921 wait complete. 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.622+0000 7fe3c1400640 1 Processor -- start 2024-08-17T02:27:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 -- start start 2024-08-17T02:27:23.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0cf100 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc1436d0 con 0x7fe3bc0ada10 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.623+0000 7fe3c1400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3bc0cc9f0 con 0x7fe3bc0b1120 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45388/0 (socket says 172.21.15.46:45388) 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 -- 172.21.15.46:0/2719389228 learned_addr learned my addr 172.21.15.46:0/2719389228 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3ba800640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3b9e00640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 -- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 msgr2=0x7fe3bc0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 -- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3bc0ada10 msgr2=0x7fe3bc143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 -- 172.21.15.46:0/2719389228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac009390 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.624+0000 7fe3bb200640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400cbc0 tx=0x7fe3b40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.625+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400a640 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.625+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400a7a0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.625+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3bc157df0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.625+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400ab20 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.625+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3bc0cc3a0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.626+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3bc0ccb60 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.626+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe3b40070f0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.626+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fe3b401bae0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.629+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe3b401be50 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.651 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.650+0000 7fa1edb6cec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.693+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3bc064db0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.693+0000 7fe3b2000640 1 -- 172.21.15.46:0/2719389228 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fe3b40073a0 con 0x7fe3bc0b36e0 2024-08-17T02:27:23.694 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:23.695 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:23.353290+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.694+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 msgr2=0x7fe3bc0cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.694+0000 7fe3c1400640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400cbc0 tx=0x7fe3b40019c0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 shutdown_connections 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3bc0b36e0 0x7fe3bc0cebc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3bc0b1120 0x7fe3bc0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 --2- 172.21.15.46:0/2719389228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3bc0ada10 0x7fe3bc143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 >> 172.21.15.46:0/2719389228 conn(0x7fe3bc0cfdf0 msgr2=0x7fe3bc067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 shutdown_connections 2024-08-17T02:27:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:23.695+0000 7fe3c1400640 1 -- 172.21.15.46:0/2719389228 wait complete. 2024-08-17T02:27:23.710 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:27:23.711 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:27:23.910 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.909+0000 7fc474cd3ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:23.936 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.936+0000 7fa1edb6cec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:23.965 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:23.964+0000 7fc474cd3ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:23.989 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:23.988+0000 7fa1edb6cec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:24.074 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-08-17T02:27:24.074+0000 7fdae5a142c0 -1 Falling back to public interface 2024-08-17T02:27:24.078 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-08-17T02:27:24.078+0000 7f5ae8d2f2c0 -1 Falling back to public interface 2024-08-17T02:27:24.079 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-17T02:27:24.078+0000 7f0c387232c0 -1 Falling back to public interface 2024-08-17T02:27:24.079 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-08-17T02:27:24.079+0000 7f10df20c2c0 -1 Falling back to public interface 2024-08-17T02:27:24.086 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-08-17T02:27:24.086+0000 7fe5ce7252c0 -1 Falling back to public interface 2024-08-17T02:27:24.088 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-17T02:27:24.087+0000 7f0c848112c0 -1 Falling back to public interface 2024-08-17T02:27:24.113 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-17T02:27:24.113+0000 7f1179e5a2c0 -1 Falling back to public interface 2024-08-17T02:27:24.135 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-17T02:27:24.135+0000 7f02da0162c0 -1 Falling back to public interface 2024-08-17T02:27:24.158 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:24.157+0000 7fc474cd3ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:24.169 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.168+0000 7fa1edb6cec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:24.216 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:24.216+0000 7fc474cd3ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:24.224 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.224+0000 7fa1edb6cec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:24.299 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:24.298+0000 7fc474cd3ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:24.302 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.301+0000 7fa1edb6cec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:24.352 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:24.351+0000 7fc474cd3ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:24.353 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.352+0000 7fa1edb6cec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:24.516 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:24.650 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.649+0000 7f2f9d200640 1 Processor -- start 2024-08-17T02:27:24.650 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.649+0000 7f2f9d200640 1 -- start start 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.650+0000 7f2f9d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.650+0000 7f2f9d200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.650+0000 7f2f9d200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980aaa30 con 0x7f2f980cd270 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.650+0000 7f2f9d200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980aaff0 con 0x7f2f98069880 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.650+0000 7f2f9d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98068e70 con 0x7f2f98158ed0 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.652 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:53936/0 (socket says 172.21.15.46:53936) 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 -- 172.21.15.46:0/551764999 learned_addr learned my addr 172.21.15.46:0/551764999 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95400640 1 --2- 172.21.15.46:0/551764999 >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:33784/0 (socket says 172.21.15.46:33784) 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f96800640 1 --1- 172.21.15.46:0/551764999 >> v1:172.21.15.162:6789/0 conn(0x7f2f980cd270 0x7f2f980c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:58120/0 (socket says 172.21.15.46:58120) 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 -- 172.21.15.46:0/551764999 >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 msgr2=0x7f2f980ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 --2- 172.21.15.46:0/551764999 >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 -- 172.21.15.46:0/551764999 >> v1:172.21.15.162:6789/0 conn(0x7f2f980cd270 legacy=0x7f2f980c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95e00640 1 -- 172.21.15.46:0/551764999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98069150 con 0x7f2f98158ed0 2024-08-17T02:27:24.653 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.651+0000 7f2f95400640 1 --2- 172.21.15.46:0/551764999 >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:24.654 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.652+0000 7f2f95e00640 1 --2- 172.21.15.46:0/551764999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009910 tx=0x7f2f880091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4be40b15a1cf285 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.654 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.652+0000 7f2f94a00640 1 -- 172.21.15.46:0/551764999 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8802adb0 con 0x7f2f98158ed0 2024-08-17T02:27:24.654 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.652+0000 7f2f94a00640 1 -- 172.21.15.46:0/551764999 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f88032440 con 0x7f2f98158ed0 2024-08-17T02:27:24.654 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.652+0000 7f2f94a00640 1 -- 172.21.15.46:0/551764999 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88032820 con 0x7f2f98158ed0 2024-08-17T02:27:24.654 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 -- 172.21.15.46:0/551764999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 msgr2=0x7f2f98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 --2- 172.21.15.46:0/551764999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009910 tx=0x7f2f880091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 -- 172.21.15.46:0/551764999 shutdown_connections 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 --2- 172.21.15.46:0/551764999 >> v2:172.21.15.162:3300/0 conn(0x7f2f98069880 0x7f2f980ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 --2- 172.21.15.46:0/551764999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f98068850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 -- 172.21.15.46:0/551764999 >> 172.21.15.46:0/551764999 conn(0x7f2f98096a30 msgr2=0x7f2f98096e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 -- 172.21.15.46:0/551764999 shutdown_connections 2024-08-17T02:27:24.655 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.653+0000 7f2f9d200640 1 -- 172.21.15.46:0/551764999 wait complete. 2024-08-17T02:27:24.656 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.656+0000 7f2f9d200640 1 Processor -- start 2024-08-17T02:27:24.656 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.656+0000 7f2f9d200640 1 -- start start 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 0x7f2f980b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f980b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ae670 con 0x7f2f980cd270 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ae910 con 0x7f2f98069880 2024-08-17T02:27:24.660 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.657+0000 7f2f9d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980aebf0 con 0x7f2f98158ed0 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 0x7f2f980b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45392/0 (socket says 172.21.15.46:45392) 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 -- 172.21.15.46:0/621232590 learned_addr learned my addr 172.21.15.46:0/621232590 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f96800640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f980b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 -- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 msgr2=0x7f2f980b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f980b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 -- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 msgr2=0x7f2f980b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 0x7f2f980b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 -- 172.21.15.46:0/621232590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009390 con 0x7f2f980cd270 2024-08-17T02:27:24.661 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f96800640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f980b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95e00640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 0x7f2f980b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.658+0000 7f2f95400640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400ec80 tx=0x7f2f840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400eec0 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400cbc0 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84013470 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f88009450 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f980af1b0 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2f84005970 con 0x7f2f980cd270 2024-08-17T02:27:24.662 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.659+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f2f84006700 con 0x7f2f980cd270 2024-08-17T02:27:24.663 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.660+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f98064a50 con 0x7f2f980cd270 2024-08-17T02:27:24.663 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.663+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f2f84021060 con 0x7f2f980cd270 2024-08-17T02:27:24.727 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.726+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9806b270 con 0x7f2f980cd270 2024-08-17T02:27:24.727 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.727+0000 7f2f8d600640 1 -- 172.21.15.46:0/621232590 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f2f84029020 con 0x7f2f980cd270 2024-08-17T02:27:24.727 INFO:teuthology.misc.health.smithi046.stdout: 2024-08-17T02:27:24.728 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:23.353290+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 msgr2=0x7f2f9806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400ec80 tx=0x7f2f840090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 shutdown_connections 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f98158ed0 0x7f2f980b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f980cd270 0x7f2f9806bf80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 --2- 172.21.15.46:0/621232590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f98069880 0x7f2f980b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 >> 172.21.15.46:0/621232590 conn(0x7f2f98096a30 msgr2=0x7f2f980ab580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 shutdown_connections 2024-08-17T02:27:24.729 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:24.728+0000 7f2f9d200640 1 -- 172.21.15.46:0/621232590 wait complete. 2024-08-17T02:27:24.740 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:27:24.882 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.881+0000 7fa1edb6cec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:24.904 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:24.903+0000 7fc474cd3ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:24.995 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:24.994+0000 7fa1edb6cec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:25.020 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-08-17T02:27:25.019+0000 7fc474cd3ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:26.015 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:26.013+0000 7fa1d1e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:27:26.016 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-08-17T02:27:26.015+0000 7fa1d1e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:27:27.628 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-17T02:27:27.627+0000 7f0c387232c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:27:27.668 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-08-17T02:27:27.667+0000 7f5ae8d2f2c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:27:27.703 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-08-17T02:27:27.702+0000 7fe5ce7252c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:27:27.724 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-17T02:27:27.724+0000 7f02da0162c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:27:27.725 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-08-17T02:27:27.724+0000 7f10df20c2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:27:27.747 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-17T02:27:27.746+0000 7f1179e5a2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:27:27.840 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-08-17T02:27:27.839+0000 7fdae5a142c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:27:27.922 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-17T02:27:27.921+0000 7f0c848112c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:27:30.765 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-08-17T02:27:30.764+0000 7f5ae2400640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:27:30.774 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-08-17T02:27:30.772+0000 7f5ad9800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:30.796 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-08-17T02:27:30.795+0000 7fdadee00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:27:30.802 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-08-17T02:27:30.802+0000 7fe5c7e00640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:27:30.803 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-08-17T02:27:30.803+0000 7fdad6200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:30.809 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-08-17T02:27:30.808+0000 7fe5bf200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:30.815 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-08-17T02:27:30.815+0000 7f10d8600640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:27:30.820 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-08-17T02:27:30.820+0000 7f10cfa00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:31.225 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-17T02:27:31.224+0000 7f0c7dc00640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:27:31.234 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-08-17T02:27:31.233+0000 7f0c75000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:31.259 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-17T02:27:31.258+0000 7f0c31e00640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:27:31.266 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-08-17T02:27:31.265+0000 7f0c29200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:31.337 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-17T02:27:31.336+0000 7f1173c00640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:27:31.345 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-08-17T02:27:31.344+0000 7f116b000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:31.345 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-17T02:27:31.344+0000 7f02d3400640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:27:31.351 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-08-17T02:27:31.351+0000 7f02ca800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:31.547 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:31.689 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.688+0000 7fed16200640 1 Processor -- start 2024-08-17T02:27:31.689 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.688+0000 7fed16200640 1 -- start start 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fed1013f2f0 0x7fed100c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed1013f6c0 0x7fed100cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed100ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100cb8f0 con 0x7fed1013f6c0 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100ca310 con 0x7fed1013f2f0 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed16200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100ca5f0 con 0x7fed1006e5e0 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed1013f6c0 0x7fed100cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed1013f6c0 0x7fed100cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48708/0 (socket says 172.21.15.46:48708) 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 -- 172.21.15.46:0/379674323 learned_addr learned my addr 172.21.15.46:0/379674323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:31.691 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed0f400640 1 --2- 172.21.15.46:0/379674323 >> v2:172.21.15.162:3300/0 conn(0x7fed1013f2f0 0x7fed100c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.692 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed0fe00640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed100ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.692 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 -- 172.21.15.46:0/379674323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 msgr2=0x7fed100ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.692 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed100ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.692 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 -- 172.21.15.46:0/379674323 >> v2:172.21.15.162:3300/0 conn(0x7fed1013f2f0 msgr2=0x7fed100c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 --2- 172.21.15.46:0/379674323 >> v2:172.21.15.162:3300/0 conn(0x7fed1013f2f0 0x7fed100c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.690+0000 7fed07e00640 1 -- 172.21.15.46:0/379674323 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100ca8d0 con 0x7fed1013f6c0 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.691+0000 7fed07e00640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f6c0 0x7fed100cb3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed1006c680 tx=0x7fecf80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5931946e274ad588 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed0ea00640 1 -- 172.21.15.46:0/379674323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf802ae60 con 0x7fed1013f6c0 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed0ea00640 1 -- 172.21.15.46:0/379674323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf8032440 con 0x7fed1013f6c0 2024-08-17T02:27:31.693 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed0ea00640 1 -- 172.21.15.46:0/379674323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80327e0 con 0x7fed1013f6c0 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 -- 172.21.15.46:0/379674323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f6c0 msgr2=0x7fed100cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f6c0 0x7fed100cb3b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed1006c680 tx=0x7fecf80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 -- 172.21.15.46:0/379674323 shutdown_connections 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed100ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 --2- 172.21.15.46:0/379674323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f6c0 0x7fed100cb3b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 --2- 172.21.15.46:0/379674323 >> v2:172.21.15.162:3300/0 conn(0x7fed1013f2f0 0x7fed100c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.692+0000 7fed16200640 1 -- 172.21.15.46:0/379674323 >> 172.21.15.46:0/379674323 conn(0x7fed10067810 msgr2=0x7fed1006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.694 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.693+0000 7fed16200640 1 -- 172.21.15.46:0/379674323 shutdown_connections 2024-08-17T02:27:31.695 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.693+0000 7fed16200640 1 -- 172.21.15.46:0/379674323 wait complete. 2024-08-17T02:27:31.695 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.694+0000 7fed16200640 1 Processor -- start 2024-08-17T02:27:31.695 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.694+0000 7fed16200640 1 -- start start 2024-08-17T02:27:31.697 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed101553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.697 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.697 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 0x7fed10158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.697 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10159a60 con 0x7fed1013f2f0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed10157e40 con 0x7fed1013f6c0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed16200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed10158e50 con 0x7fed1006e5e0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed07e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed07e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48718/0 (socket says 172.21.15.46:48718) 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed07e00640 1 -- 172.21.15.46:0/3443582147 learned_addr learned my addr 172.21.15.46:0/3443582147 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed0fe00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 0x7fed10158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.695+0000 7fed0f400640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed101553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 -- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 msgr2=0x7fed101553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed101553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 -- 172.21.15.46:0/3443582147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 msgr2=0x7fed101582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.698 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 -- 172.21.15.46:0/3443582147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8009450 con 0x7fed1013f6c0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed07e00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed0fe00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 0x7fed10158820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800cd40 con 0x7fed1013f6c0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0800f040 con 0x7fed1013f6c0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed10159130 con 0x7fed1013f6c0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0800cea0 con 0x7fed1013f6c0 2024-08-17T02:27:31.699 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.696+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed101596f0 con 0x7fed1013f6c0 2024-08-17T02:27:31.700 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.697+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed10159c10 con 0x7fed1013f6c0 2024-08-17T02:27:31.700 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.698+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fed080148e0 con 0x7fed1013f6c0 2024-08-17T02:27:31.700 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.699+0000 7fed06a00640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 0x7fecec0675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:31.700 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.699+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fed08082210 con 0x7fed1013f6c0 2024-08-17T02:27:31.701 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.699+0000 7fed0f400640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 0x7fecec0675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:31.701 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.700+0000 7fed0f400640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 0x7fecec0675a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed00009c90 tx=0x7fed000090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:31.704 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.704+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fed10159c10 con 0x7fed1013f6c0 2024-08-17T02:27:31.899 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.898+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed10159c10 con 0x7fed1013f6c0 2024-08-17T02:27:31.900 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.899+0000 7fed06a00640 1 -- 172.21.15.46:0/3443582147 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7fed10159c10 con 0x7fed1013f6c0 2024-08-17T02:27:31.901 INFO:teuthology.misc.health.smithi046.stdout: 2024-08-17T02:27:31.901 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":13,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:31.771983+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 msgr2=0x7fecec0675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 0x7fecec0675a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed00009c90 tx=0x7fed000090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 msgr2=0x7fed10158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 0x7fed10158820 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fed08009e50 tx=0x7fed0800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 shutdown_connections 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1013f6c0 0x7fed10158820 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed1013f2f0 0x7fed101582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fecec0650f0 0x7fecec0675a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.903 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 --2- 172.21.15.46:0/3443582147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1006e5e0 0x7fed101553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:31.904 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 >> 172.21.15.46:0/3443582147 conn(0x7fed10067810 msgr2=0x7fed1006db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:31.904 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 shutdown_connections 2024-08-17T02:27:31.904 INFO:teuthology.misc.health.smithi046.stderr:2024-08-17T02:27:31.902+0000 7fed16200640 1 -- 172.21.15.46:0/3443582147 wait complete. 2024-08-17T02:27:31.914 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:27:31.915 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:27:31.915 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:31.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:31.919 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:31.919 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:31.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:31.923 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:31.923 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:31.923 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:31.927 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:31.927 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:31.927 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:31.931 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:31.931 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:27:31.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:32.046 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-08-17T02:27:32.048 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-08-17T02:27:32.054 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-17T02:27:32.059 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-17T02:27:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.091+0000 7f362c800640 1 Processor -- start 2024-08-17T02:27:32.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.091+0000 7f362c800640 1 -- start start 2024-08-17T02:27:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.092+0000 7f362c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36240caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.092+0000 7f362c800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36240caa80 con 0x7f3624140580 2024-08-17T02:27:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.092+0000 7f362c800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36240c9e70 con 0x7f36240b1440 2024-08-17T02:27:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.092+0000 7f362c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240cb450 con 0x7f36241401b0 2024-08-17T02:27:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3624140580 0x7f36240b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35896/0 (socket says 172.21.15.46:35896) 2024-08-17T02:27:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629400640 1 -- 172.21.15.46:0/3607845533 learned_addr learned my addr 172.21.15.46:0/3607845533 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629e00640 1 --2- 172.21.15.46:0/3607845533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36240caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268987308 0 0) 0x7f36240caa80 con 0x7f3624140580 2024-08-17T02:27:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f360c0034e0 con 0x7f3624140580 2024-08-17T02:27:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872509847 0 0) 0x7f36240c9e70 con 0x7f36240b1440 2024-08-17T02:27:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629e00640 1 -- 172.21.15.46:0/3607845533 >> v1:172.21.15.162:6789/0 conn(0x7f36240b1440 legacy=0x7f36240c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629e00640 1 -- 172.21.15.46:0/3607845533 >> v1:172.21.15.46:6789/0 conn(0x7f3624140580 legacy=0x7f36240b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.093+0000 7f3629e00640 1 -- 172.21.15.46:0/3607845533 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36240ca150 con 0x7f36241401b0 2024-08-17T02:27:32.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.094+0000 7f3629e00640 1 --2- 172.21.15.46:0/3607845533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36240caf10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3618009880 tx=0x7f36180090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ef97ae13e0375f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.094+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361802ad80 con 0x7f36241401b0 2024-08-17T02:27:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618032440 con 0x7f36241401b0 2024-08-17T02:27:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f3628a00640 1 -- 172.21.15.46:0/3607845533 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36180327e0 con 0x7f36241401b0 2024-08-17T02:27:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 -- 172.21.15.46:0/3607845533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 msgr2=0x7f36240caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 --2- 172.21.15.46:0/3607845533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36240caf10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3618009880 tx=0x7f36180090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 -- 172.21.15.46:0/3607845533 shutdown_connections 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 --2- 172.21.15.46:0/3607845533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36240caf10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 -- 172.21.15.46:0/3607845533 >> 172.21.15.46:0/3607845533 conn(0x7f36240cb9b0 msgr2=0x7f36240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 -- 172.21.15.46:0/3607845533 shutdown_connections 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.095+0000 7f362c800640 1 -- 172.21.15.46:0/3607845533 wait complete. 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.097+0000 7f362c800640 1 Processor -- start 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.097+0000 7f362c800640 1 -- start start 2024-08-17T02:27:32.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36241671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3624140580 0x7f3624167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3624169a20 con 0x7f3624140580 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36240a8dd0 con 0x7f36240b1440 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36240a90b0 con 0x7f36241401b0 2024-08-17T02:27:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36241671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:36746/0 (socket says 172.21.15.46:36746) 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 -- 172.21.15.46:0/221489593 learned_addr learned my addr 172.21.15.46:0/221489593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f362a800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3624140580 0x7f3624167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 -- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 msgr2=0x7f36241671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36241671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 -- 172.21.15.46:0/221489593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3624140580 msgr2=0x7f3624167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3624140580 0x7f3624167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629e00640 1 -- 172.21.15.46:0/221489593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618009390 con 0x7f36240b1440 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.098+0000 7f3629400640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36241671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f3629e00640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36180097d0 tx=0x7f3618032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618031a60 con 0x7f36240b1440 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618031bc0 con 0x7f36240b1440 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361803b400 con 0x7f36240b1440 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36240a9390 con 0x7f36240b1440 2024-08-17T02:27:32.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.099+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36240ab1e0 con 0x7f36240b1440 2024-08-17T02:27:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.100+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624064db0 con 0x7f36240b1440 2024-08-17T02:27:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.101+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f3618043030 con 0x7f36240b1440 2024-08-17T02:27:32.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.102+0000 7f361d600640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 0x7f3608067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.102+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f3618041070 con 0x7f36240b1440 2024-08-17T02:27:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.102+0000 7f3629400640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 0x7f3608067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.103+0000 7f3629400640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 0x7f3608067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3624168340 tx=0x7f3614009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.106+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3618071220 con 0x7f36240b1440 2024-08-17T02:27:32.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.291+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3624168390 con 0x7f36240b1440 2024-08-17T02:27:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.292+0000 7f361d600640 1 -- 172.21.15.46:0/221489593 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7f3618037090 con 0x7f36240b1440 2024-08-17T02:27:32.293 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:32.293 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:31.771983+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 msgr2=0x7f3608067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 0x7f3608067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3624168340 tx=0x7f3614009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 msgr2=0x7f36240aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f36180097d0 tx=0x7f3618032000 comp rx=0 tx=0).stop 2024-08-17T02:27:32.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 shutdown_connections 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3624140580 0x7f3624167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f36080650c0 0x7f3608067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36241401b0 0x7f36241671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 --2- 172.21.15.46:0/221489593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240b1440 0x7f36240aaca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 >> 172.21.15.46:0/221489593 conn(0x7f36240cb9b0 msgr2=0x7f362406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 shutdown_connections 2024-08-17T02:27:32.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.294+0000 7f362c800640 1 -- 172.21.15.46:0/221489593 wait complete. 2024-08-17T02:27:32.310 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:27:32.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:32.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.462+0000 7f2533400640 1 Processor -- start 2024-08-17T02:27:32.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.462+0000 7f2533400640 1 -- start start 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f2533400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f252c0b3370 0x7f252c0b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f2533400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0d0ab0 con 0x7f252c0b1120 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f2533400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c0b00c0 con 0x7f252c0ada10 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f2533400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c0b0360 con 0x7f252c0b3370 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f252be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f252c0b1120 0x7f252c0aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35898/0 (socket says 172.21.15.46:35898) 2024-08-17T02:27:32.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f252be00640 1 -- 172.21.15.46:0/3249368611 learned_addr learned my addr 172.21.15.46:0/3249368611 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:32.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.463+0000 7f2531400640 1 --2- 172.21.15.46:0/3249368611 >> v2:172.21.15.162:3300/0 conn(0x7f252c0b3370 0x7f252c0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221427283 0 0) 0x7f252c0d0ab0 con 0x7f252c0b1120 2024-08-17T02:27:32.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25140034e0 con 0x7f252c0b1120 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155660015 0 0) 0x7f252c0b00c0 con 0x7f252c0ada10 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f252c0d0ab0 con 0x7f252c0ada10 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f2531400640 1 -- 172.21.15.46:0/3249368611 >> v1:172.21.15.162:6789/0 conn(0x7f252c0ada10 legacy=0x7f252c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f2531400640 1 -- 172.21.15.46:0/3249368611 >> v1:172.21.15.46:6789/0 conn(0x7f252c0b1120 legacy=0x7f252c0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.464+0000 7f2531400640 1 -- 172.21.15.46:0/3249368611 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c0b0640 con 0x7f252c0b3370 2024-08-17T02:27:32.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.465+0000 7f2531400640 1 --2- 172.21.15.46:0/3249368611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c0b37f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2524009e60 tx=0x7f2524009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d243a0296284f0aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.465+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524030560 con 0x7f252c0b3370 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.465+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25240306c0 con 0x7f252c0b3370 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.465+0000 7f252b400640 1 -- 172.21.15.46:0/3249368611 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524030a40 con 0x7f252c0b3370 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 -- 172.21.15.46:0/3249368611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 msgr2=0x7f252c0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 --2- 172.21.15.46:0/3249368611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c0b37f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2524009e60 tx=0x7f2524009780 comp rx=0 tx=0).stop 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 -- 172.21.15.46:0/3249368611 shutdown_connections 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 --2- 172.21.15.46:0/3249368611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c0b37f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 -- 172.21.15.46:0/3249368611 >> 172.21.15.46:0/3249368611 conn(0x7f252c0cfdf0 msgr2=0x7f252c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 -- 172.21.15.46:0/3249368611 shutdown_connections 2024-08-17T02:27:32.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.466+0000 7f2533400640 1 -- 172.21.15.46:0/3249368611 wait complete. 2024-08-17T02:27:32.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.467+0000 7f2533400640 1 Processor -- start 2024-08-17T02:27:32.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.468+0000 7f2533400640 1 -- start start 2024-08-17T02:27:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.468+0000 7f2533400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 0x7f252c168b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.468+0000 7f2533400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2533400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2533400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c09c3c0 con 0x7f252c0b1120 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2533400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c099b00 con 0x7f252c0b3370 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2533400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c09bb20 con 0x7f252c0ada10 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48786/0 (socket says 172.21.15.46:48786) 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 -- 172.21.15.46:0/2052662236 learned_addr learned my addr 172.21.15.46:0/2052662236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2531400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2530a00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 0x7f252c168b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 -- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 msgr2=0x7f252c168b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 0x7f252c168b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 -- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 msgr2=0x7f252c158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f252be00640 1 -- 172.21.15.46:0/2052662236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524009a20 con 0x7f252c0b1120 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.469+0000 7f2530a00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 0x7f252c168b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f252be00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2518005840 tx=0x7f2518007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518005aa0 con 0x7f252c0b1120 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2518005c00 con 0x7f252c0b1120 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180070f0 con 0x7f252c0b1120 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c09be00 con 0x7f252c0b1120 2024-08-17T02:27:32.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.470+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c099d10 con 0x7f252c0b1120 2024-08-17T02:27:32.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.471+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c169110 con 0x7f252c0b1120 2024-08-17T02:27:32.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.472+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f2518007520 con 0x7f252c0b1120 2024-08-17T02:27:32.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.472+0000 7f251fe00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 0x7f250c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:32.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.472+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f2518081910 con 0x7f252c0b1120 2024-08-17T02:27:32.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.473+0000 7f2530a00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 0x7f250c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:32.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.473+0000 7f2530a00640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 0x7f250c067570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:32.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.477+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f251804ff60 con 0x7f252c0b1120 2024-08-17T02:27:32.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.702+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f252c064db0 con 0x7f252c0b1120 2024-08-17T02:27:32.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.703+0000 7f251fe00640 1 -- 172.21.15.46:0/2052662236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f2518053580 con 0x7f252c0b1120 2024-08-17T02:27:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:32.704 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:27:32.704 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 msgr2=0x7f250c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 0x7f250c067570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520009040 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 msgr2=0x7f252c0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2518005840 tx=0x7f2518007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 shutdown_connections 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f252c0b3370 0x7f252c158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f252c0b1120 0x7f252c0cef80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f250c0650c0 0x7f250c067570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 --2- 172.21.15.46:0/2052662236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f252c0ada10 0x7f252c168b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:32.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 >> 172.21.15.46:0/2052662236 conn(0x7f252c0cfdf0 msgr2=0x7f252c1545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 shutdown_connections 2024-08-17T02:27:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:32.705+0000 7f2533400640 1 -- 172.21.15.46:0/2052662236 wait complete. 2024-08-17T02:27:34.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:34.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.883+0000 7f292b200640 1 Processor -- start 2024-08-17T02:27:34.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.883+0000 7f292b200640 1 -- start start 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f292c155900 0x7f292c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c157690 con 0x7f292c158b30 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c156a80 con 0x7f292c0b0270 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c156d60 con 0x7f292c155900 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292a800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f292c158b30 0x7f292c0ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35902/0 (socket says 172.21.15.46:35902) 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f292a800640 1 -- 172.21.15.46:0/537516351 learned_addr learned my addr 172.21.15.46:0/537516351 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:34.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.884+0000 7f2929e00640 1 --2- 172.21.15.46:0/537516351 >> v2:172.21.15.162:3300/0 conn(0x7f292c155900 0x7f292c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665875278 0 0) 0x7f292c157690 con 0x7f292c158b30 2024-08-17T02:27:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29100034e0 con 0x7f292c158b30 2024-08-17T02:27:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430878136 0 0) 0x7f292c156a80 con 0x7f292c0b0270 2024-08-17T02:27:34.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f292c157690 con 0x7f292c0b0270 2024-08-17T02:27:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929e00640 1 -- 172.21.15.46:0/537516351 >> v1:172.21.15.162:6789/0 conn(0x7f292c0b0270 legacy=0x7f292c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929e00640 1 -- 172.21.15.46:0/537516351 >> v1:172.21.15.46:6789/0 conn(0x7f292c158b30 legacy=0x7f292c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.885+0000 7f2929e00640 1 -- 172.21.15.46:0/537516351 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c157040 con 0x7f292c155900 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.886+0000 7f2929e00640 1 --2- 172.21.15.46:0/537516351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c155900 0x7f292c155cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291c009850 tx=0x7f291c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=108b20a1f9eaa773 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.886+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c02ae20 con 0x7f292c155900 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.886+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c032440 con 0x7f292c155900 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.886+0000 7f2929400640 1 -- 172.21.15.46:0/537516351 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0327e0 con 0x7f292c155900 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 -- 172.21.15.46:0/537516351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c155900 msgr2=0x7f292c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 --2- 172.21.15.46:0/537516351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c155900 0x7f292c155cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291c009850 tx=0x7f291c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 -- 172.21.15.46:0/537516351 shutdown_connections 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 --2- 172.21.15.46:0/537516351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c155900 0x7f292c155cd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 -- 172.21.15.46:0/537516351 >> 172.21.15.46:0/537516351 conn(0x7f292c067750 msgr2=0x7f292c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 -- 172.21.15.46:0/537516351 shutdown_connections 2024-08-17T02:27:34.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.887+0000 7f292b200640 1 -- 172.21.15.46:0/537516351 wait complete. 2024-08-17T02:27:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.888+0000 7f292b200640 1 Processor -- start 2024-08-17T02:27:34.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.888+0000 7f292b200640 1 -- start start 2024-08-17T02:27:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 0x7f292c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f292c155900 0x7f292c0ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 0x7f292c0696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0ab020 con 0x7f292c158b30 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0a9e10 con 0x7f292c0b0270 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.889+0000 7f292b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c0aa6f0 con 0x7f292c155900 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f292a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 0x7f292c0696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f292a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 0x7f292c0696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48798/0 (socket says 172.21.15.46:48798) 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 0x7f292c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f292a800640 1 -- 172.21.15.46:0/2300476677 learned_addr learned my addr 172.21.15.46:0/2300476677 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2923e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f292c155900 0x7f292c0ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 -- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f292c155900 msgr2=0x7f292c0ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f292c155900 0x7f292c0ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 -- 172.21.15.46:0/2300476677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 msgr2=0x7f292c0696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 0x7f292c0696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 -- 172.21.15.46:0/2300476677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009390 con 0x7f292c0b0270 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.890+0000 7f2929e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 0x7f292c152280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f291c031000 tx=0x7f291c032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.891+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c000c40 con 0x7f292c0b0270 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.891+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c031a60 con 0x7f292c0b0270 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.891+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c031e20 con 0x7f292c0b0270 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.891+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c0aa9d0 con 0x7f292c0b0270 2024-08-17T02:27:34.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.891+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c1527c0 con 0x7f292c0b0270 2024-08-17T02:27:34.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.892+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c1529b0 con 0x7f292c0b0270 2024-08-17T02:27:34.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.893+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f291c039040 con 0x7f292c0b0270 2024-08-17T02:27:34.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.893+0000 7f2921600640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 0x7f2908067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:34.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.893+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f291c0a1a40 con 0x7f292c0b0270 2024-08-17T02:27:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.894+0000 7f2923e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 0x7f2908067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:34.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.894+0000 7f2923e00640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 0x7f2908067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f292c15f9e0 tx=0x7f2914007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:34.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:34.898+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f292c1529b0 con 0x7f292c0b0270 2024-08-17T02:27:35.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.124+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f292c1529b0 con 0x7f292c0b0270 2024-08-17T02:27:35.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.125+0000 7f2921600640 1 -- 172.21.15.46:0/2300476677 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f292c1529b0 con 0x7f292c0b0270 2024-08-17T02:27:35.126 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:35.126 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:27:35.127 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 msgr2=0x7f2908067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 0x7f2908067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f292c15f9e0 tx=0x7f2914007cc0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 msgr2=0x7f292c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 0x7f292c152280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f291c031000 tx=0x7f291c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 shutdown_connections 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f292c158b30 0x7f292c0696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29080650c0 0x7f2908067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f292c155900 0x7f292c0ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 --2- 172.21.15.46:0/2300476677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f292c0b0270 0x7f292c152280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 >> 172.21.15.46:0/2300476677 conn(0x7f292c067750 msgr2=0x7f292c0af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 shutdown_connections 2024-08-17T02:27:35.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.128+0000 7f292b200640 1 -- 172.21.15.46:0/2300476677 wait complete. 2024-08-17T02:27:35.143 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:35.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.301+0000 7fded1800640 1 Processor -- start 2024-08-17T02:27:35.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.301+0000 7fded1800640 1 -- start start 2024-08-17T02:27:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fded1800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdecc0ceb40 0x7fdecc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fded1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ccad0 0x7fdecc162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fded1800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0cadc0 con 0x7fdecc159ca0 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fded1800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc0cd6e0 con 0x7fdecc0ceb40 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fded1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0ccf70 con 0x7fdecc0ccad0 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fdecb400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdecc0ceb40 0x7fdecc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fdecb400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdecc0ceb40 0x7fdecc0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48804/0 (socket says 172.21.15.46:48804) 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fdecb400640 1 -- 172.21.15.46:0/3802565601 learned_addr learned my addr 172.21.15.46:0/3802565601 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.302+0000 7fdecbe00640 1 --1- 172.21.15.46:0/3802565601 >> v1:172.21.15.46:6789/0 conn(0x7fdecc159ca0 0x7fdecc0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35904/0 (socket says 172.21.15.46:35904) 2024-08-17T02:27:35.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fded0e00640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ccad0 0x7fdecc162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fdecb400640 1 -- 172.21.15.46:0/3802565601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ccad0 msgr2=0x7fdecc162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fdecb400640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ccad0 0x7fdecc162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fdecb400640 1 -- 172.21.15.46:0/3802565601 >> v1:172.21.15.46:6789/0 conn(0x7fdecc159ca0 legacy=0x7fdecc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fdecb400640 1 -- 172.21.15.46:0/3802565601 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0cb060 con 0x7fdecc0ceb40 2024-08-17T02:27:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.303+0000 7fdecaa00640 1 -- 172.21.15.46:0/3802565601 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195551432 0 0) 0x7fdecc0cadc0 con 0x7fdecc159ca0 2024-08-17T02:27:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.304+0000 7fdecb400640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ceb40 0x7fdecc0cc590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009910 tx=0x7fdeb80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f16a5009310dfb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.304+0000 7fdecaa00640 1 -- 172.21.15.46:0/3802565601 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb802ae40 con 0x7fdecc0ceb40 2024-08-17T02:27:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.304+0000 7fdecaa00640 1 -- 172.21.15.46:0/3802565601 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb8032440 con 0x7fdecc0ceb40 2024-08-17T02:27:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.304+0000 7fdecaa00640 1 -- 172.21.15.46:0/3802565601 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80327e0 con 0x7fdecc0ceb40 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 -- 172.21.15.46:0/3802565601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ceb40 msgr2=0x7fdecc0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ceb40 0x7fdecc0cc590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009910 tx=0x7fdeb80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 -- 172.21.15.46:0/3802565601 shutdown_connections 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ccad0 0x7fdecc162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 --2- 172.21.15.46:0/3802565601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ceb40 0x7fdecc0cc590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 -- 172.21.15.46:0/3802565601 >> 172.21.15.46:0/3802565601 conn(0x7fdecc098e00 msgr2=0x7fdecc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 -- 172.21.15.46:0/3802565601 shutdown_connections 2024-08-17T02:27:35.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.305+0000 7fded1800640 1 -- 172.21.15.46:0/3802565601 wait complete. 2024-08-17T02:27:35.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.307+0000 7fded1800640 1 Processor -- start 2024-08-17T02:27:35.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.307+0000 7fded1800640 1 -- start start 2024-08-17T02:27:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ceb40 0x7fdecc09a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 0x7fdecc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0c91a0 con 0x7fdecc0ccad0 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc155020 con 0x7fdecc159ca0 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded1800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc099e20 con 0x7fdecc0ceb40 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48806/0 (socket says 172.21.15.46:48806) 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 -- 172.21.15.46:0/1765484769 learned_addr learned my addr 172.21.15.46:0/1765484769 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecb400640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ceb40 0x7fdecc09a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded0e00640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 0x7fdecc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 -- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ceb40 msgr2=0x7fdecc09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ceb40 0x7fdecc09a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 -- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 msgr2=0x7fdecc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 0x7fdecc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fdecbe00640 1 -- 172.21.15.46:0/1765484769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8009450 con 0x7fdecc0ccad0 2024-08-17T02:27:35.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.308+0000 7fded0e00640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 0x7fdecc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:35.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fdecbe00640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c5e0 tx=0x7fdebc007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc007300 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc007480 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0c8590 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0047a0 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.309+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc0c8b50 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.311+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc071050 con 0x7fdecc0ccad0 2024-08-17T02:27:35.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.312+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fdebc004b90 con 0x7fdecc0ccad0 2024-08-17T02:27:35.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.313+0000 7fdec3400640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 0x7fdeac067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.313+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdebc0813f0 con 0x7fdecc0ccad0 2024-08-17T02:27:35.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.313+0000 7fdecb400640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 0x7fdeac067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.314+0000 7fdecb400640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 0x7fdeac067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8034000 tx=0x7fdeb8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.318+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdebc04ce40 con 0x7fdecc0ccad0 2024-08-17T02:27:35.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.513+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdecc157020 con 0x7fdecc0ccad0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.514+0000 7fdec3400640 1 -- 172.21.15.46:0/1765484769 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12140 (secure 0 0 0) 0x7fdebc018090 con 0x7fdecc0ccad0 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:35.515 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:34.780966+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.516+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 msgr2=0x7fdeac067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.516+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 0x7fdeac067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8034000 tx=0x7fdeb8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.516+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 msgr2=0x7fdecc0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.516+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c5e0 tx=0x7fdebc007f20 comp rx=0 tx=0).stop 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 shutdown_connections 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdecc159ca0 0x7fdecc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdeac0650c0 0x7fdeac067570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdecc0ceb40 0x7fdecc09a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 --2- 172.21.15.46:0/1765484769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdecc0ccad0 0x7fdecc0c9630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 >> 172.21.15.46:0/1765484769 conn(0x7fdecc098e00 msgr2=0x7fdecc0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 shutdown_connections 2024-08-17T02:27:35.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.517+0000 7fded1800640 1 -- 172.21.15.46:0/1765484769 wait complete. 2024-08-17T02:27:35.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:35.535 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.691+0000 7f339e600640 1 Processor -- start 2024-08-17T02:27:35.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.691+0000 7f339e600640 1 -- start start 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f339e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f3398088cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f339e600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980c64a0 con 0x7f339815d0f0 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f339e600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980b26c0 con 0x7f33980b22f0 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f339e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c56e0 con 0x7f33980d08a0 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f338ea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f339815d0f0 0x7f33980ca7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35914/0 (socket says 172.21.15.46:35914) 2024-08-17T02:27:35.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.692+0000 7f338ea00640 1 -- 172.21.15.46:0/2568494429 learned_addr learned my addr 172.21.15.46:0/2568494429 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3397e00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f3398088cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892611182 0 0) 0x7f33980c64a0 con 0x7f339815d0f0 2024-08-17T02:27:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c0034e0 con 0x7f339815d0f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282435114 0 0) 0x7f33980b26c0 con 0x7f33980b22f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33980c64a0 con 0x7f33980b22f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 387973498 0 0) 0x7f337c0034e0 con 0x7f339815d0f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 msgr2=0x7f3398088cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f3398088cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 >> v1:172.21.15.162:6789/0 conn(0x7f33980b22f0 legacy=0x7f339815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980c59c0 con 0x7f339815d0f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f3380001470 con 0x7f339815d0f0 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 >> v1:172.21.15.46:6789/0 conn(0x7f339815d0f0 legacy=0x7f33980ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f337c003b90 0x7f337c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f337c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c56e0 con 0x7f337c004cc0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bab0 con 0x7f337c003b90 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.693+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c00bc70 con 0x7f33980d08a0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f3397400640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f337c003b90 0x7f337c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f337c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f3397e00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 -- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f337c003b90 msgr2=0x7f337c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f337c003b90 0x7f337c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 -- 172.21.15.46:0/2568494429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f337c004cc0 msgr2=0x7f337c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f337c004cc0 0x7f337c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f338ea00640 1 -- 172.21.15.46:0/2568494429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0034e0 con 0x7f33980d08a0 2024-08-17T02:27:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.694+0000 7f3397400640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f337c003b90 0x7f337c003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.695+0000 7f338ea00640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f337c004780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f338000c210 tx=0x7f3380001df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25310b28d90ef34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005960 con 0x7f33980d08a0 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380005ae0 con 0x7f33980d08a0 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f3396a00640 1 -- 172.21.15.46:0/2568494429 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005ea0 con 0x7f33980d08a0 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f339e600640 1 -- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 msgr2=0x7f337c004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f339e600640 1 --2- 172.21.15.46:0/2568494429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980d08a0 0x7f337c004780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f338000c210 tx=0x7f3380001df0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f3397e00640 1 -- 172.21.15.46:0/2568494429 reap_dead start 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f339e600640 1 -- 172.21.15.46:0/2568494429 shutdown_connections 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f339e600640 1 -- 172.21.15.46:0/2568494429 >> 172.21.15.46:0/2568494429 conn(0x7f33980cfd90 msgr2=0x7f33980d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.696+0000 7f339e600640 1 -- 172.21.15.46:0/2568494429 shutdown_connections 2024-08-17T02:27:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.697+0000 7f339e600640 1 -- 172.21.15.46:0/2568494429 wait complete. 2024-08-17T02:27:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.698+0000 7f339e600640 1 Processor -- start 2024-08-17T02:27:35.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.698+0000 7f339e600640 1 -- start start 2024-08-17T02:27:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 0x7f33981565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 0x7f33980c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c9890 con 0x7f33980d08a0 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980b2bc0 con 0x7f33980c8ee0 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f339e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980c8040 con 0x7f33980c7800 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48822/0 (socket says 172.21.15.46:48822) 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 -- 172.21.15.46:0/2200396945 learned_addr learned my addr 172.21.15.46:0/2200396945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f338ea00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 0x7f33981565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397e00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 0x7f33980c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 -- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 msgr2=0x7f33981565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 0x7f33981565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 -- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 msgr2=0x7f33980c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 0x7f33980c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397400640 1 -- 172.21.15.46:0/2200396945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980c8320 con 0x7f33980d08a0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.699+0000 7f3397e00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 0x7f33980c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f338ea00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 0x7f33981565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f3397400640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f338800fc00 tx=0x7f3388007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800d940 con 0x7f33980d08a0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338800daa0 con 0x7f33980d08a0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800de20 con 0x7f33980d08a0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33980c8600 con 0x7f33980d08a0 2024-08-17T02:27:35.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.700+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398156af0 con 0x7f33980d08a0 2024-08-17T02:27:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.701+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3398064db0 con 0x7f33980d08a0 2024-08-17T02:27:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.702+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f3388007230 con 0x7f33980d08a0 2024-08-17T02:27:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.703+0000 7f338f400640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 0x7f33740675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.703+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3388082060 con 0x7f33980d08a0 2024-08-17T02:27:35.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.703+0000 7f338ea00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 0x7f33740675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:35.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.704+0000 7f338ea00640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 0x7f33740675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3380033000 tx=0x7f3380034000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:35.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.707+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f33880504b0 con 0x7f33980d08a0 2024-08-17T02:27:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.896+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f339815c750 con 0x7f33980d08a0 2024-08-17T02:27:35.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.897+0000 7f338f400640 1 -- 172.21.15.46:0/2200396945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3388017020 con 0x7f33980d08a0 2024-08-17T02:27:35.897 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 msgr2=0x7f33740675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 0x7f33740675a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3380033000 tx=0x7f3380034000 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 msgr2=0x7f33980b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f338800fc00 tx=0x7f3388007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 shutdown_connections 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33980c8ee0 0x7f33980c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33740650f0 0x7f33740675a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33980c7800 0x7f33981565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 --2- 172.21.15.46:0/2200396945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33980d08a0 0x7f33980b55d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:35.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 >> 172.21.15.46:0/2200396945 conn(0x7f33980cfd90 msgr2=0x7f339815c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 shutdown_connections 2024-08-17T02:27:35.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:35.899+0000 7f339e600640 1 -- 172.21.15.46:0/2200396945 wait complete. 2024-08-17T02:27:35.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:36.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.070+0000 7f3a78a00640 1 Processor -- start 2024-08-17T02:27:36.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.070+0000 7f3a78a00640 1 -- start start 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.071+0000 7f3a78a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a74158970 0x7f3a74158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.071+0000 7f3a78a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740af590 con 0x7f3a7406ab70 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.071+0000 7f3a78a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7406afc0 con 0x7f3a740aa290 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.071+0000 7f3a78a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a740aed30 con 0x7f3a74158970 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a6be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3a7406ab70 0x7f3a740afa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35918/0 (socket says 172.21.15.46:35918) 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a6be00640 1 -- 172.21.15.46:0/4142712029 learned_addr learned my addr 172.21.15.46:0/4142712029 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a73400640 1 --2- 172.21.15.46:0/4142712029 >> v2:172.21.15.162:3300/0 conn(0x7f3a74158970 0x7f3a74158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956432891 0 0) 0x7f3a740af590 con 0x7f3a7406ab70 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a580034e0 con 0x7f3a7406ab70 2024-08-17T02:27:36.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389653099 0 0) 0x7f3a7406afc0 con 0x7f3a740aa290 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a740af590 con 0x7f3a740aa290 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a73400640 1 -- 172.21.15.46:0/4142712029 >> v1:172.21.15.162:6789/0 conn(0x7f3a740aa290 legacy=0x7f3a740b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a73400640 1 -- 172.21.15.46:0/4142712029 >> v1:172.21.15.46:6789/0 conn(0x7f3a7406ab70 legacy=0x7f3a740afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.072+0000 7f3a73400640 1 -- 172.21.15.46:0/4142712029 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740b0130 con 0x7f3a74158970 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.073+0000 7f3a73400640 1 --2- 172.21.15.46:0/4142712029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a74158970 0x7f3a74158d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a740aee70 tx=0x7f3a640090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25ce5bda06a7c518 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6402ae10 con 0x7f3a74158970 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64032440 con 0x7f3a74158970 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a72a00640 1 -- 172.21.15.46:0/4142712029 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640327c0 con 0x7f3a74158970 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 -- 172.21.15.46:0/4142712029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a74158970 msgr2=0x7f3a74158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 --2- 172.21.15.46:0/4142712029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a74158970 0x7f3a74158d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a740aee70 tx=0x7f3a640090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 -- 172.21.15.46:0/4142712029 shutdown_connections 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 --2- 172.21.15.46:0/4142712029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a74158970 0x7f3a74158d40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 -- 172.21.15.46:0/4142712029 >> 172.21.15.46:0/4142712029 conn(0x7f3a74067750 msgr2=0x7f3a74068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 -- 172.21.15.46:0/4142712029 shutdown_connections 2024-08-17T02:27:36.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.074+0000 7f3a78a00640 1 -- 172.21.15.46:0/4142712029 wait complete. 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.076+0000 7f3a78a00640 1 Processor -- start 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.076+0000 7f3a78a00640 1 -- start start 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7406ab70 0x7f3a740c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a74158970 0x7f3a74147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740c5510 con 0x7f3a740aa290 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740c3ff0 con 0x7f3a7406ab70 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a78a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7416a410 con 0x7f3a74158970 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48838/0 (socket says 172.21.15.46:48838) 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 -- 172.21.15.46:0/2361598517 learned_addr learned my addr 172.21.15.46:0/2361598517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a73400640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7406ab70 0x7f3a740c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a73e00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a74158970 0x7f3a74147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 -- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a74158970 msgr2=0x7f3a74147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a74158970 0x7f3a74147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 -- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7406ab70 msgr2=0x7f3a740c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7406ab70 0x7f3a740c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.077+0000 7f3a6be00640 1 -- 172.21.15.46:0/2361598517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64009390 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a6be00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c580 tx=0x7f3a5c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c005aa0 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c005c00 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0070f0 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740c33e0 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.078+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a740c39a0 con 0x7f3a740aa290 2024-08-17T02:27:36.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.079+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a740c4180 con 0x7f3a740aa290 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.080+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f3a5c0074a0 con 0x7f3a740aa290 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.081+0000 7f3a6aa00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 0x7f3a50067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.081+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3a5c081930 con 0x7f3a740aa290 2024-08-17T02:27:36.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.081+0000 7f3a73400640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 0x7f3a50067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.082+0000 7f3a73400640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 0x7f3a50067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a64032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.085+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3a5c04feb0 con 0x7f3a740aa290 2024-08-17T02:27:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.272+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3a74071050 con 0x7f3a740aa290 2024-08-17T02:27:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.272+0000 7f3a6aa00640 1 -- 172.21.15.46:0/2361598517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3a5c0534d0 con 0x7f3a740aa290 2024-08-17T02:27:36.273 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:36.273 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-08-17T02:27:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:27:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-08-17T02:27:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-08-17T02:27:36.274 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:27:36.275 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-08-17T02:27:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 msgr2=0x7f3a50067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 0x7f3a50067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a64032000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 msgr2=0x7f3a74169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c580 tx=0x7f3a5c007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 shutdown_connections 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a500650c0 0x7f3a50067570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a74158970 0x7f3a74147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a740aa290 0x7f3a74169ed0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 --2- 172.21.15.46:0/2361598517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a7406ab70 0x7f3a740c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.274+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 >> 172.21.15.46:0/2361598517 conn(0x7f3a74067750 msgr2=0x7f3a740cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.275+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 shutdown_connections 2024-08-17T02:27:36.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.275+0000 7f3a78a00640 1 -- 172.21.15.46:0/2361598517 wait complete. 2024-08-17T02:27:36.290 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:36.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.446+0000 7f7683e00640 1 Processor -- start 2024-08-17T02:27:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.447+0000 7f7683e00640 1 -- start start 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7683e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76840ac290 0x7f76840ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7683e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76840aed20 con 0x7f7684068d40 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7683e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76840ae460 con 0x7f76840af1b0 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7683e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7684069880 con 0x7f76840ac290 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7682a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76840ac290 0x7f76840ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7682a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f76840ac290 0x7f76840ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48844/0 (socket says 172.21.15.46:48844) 2024-08-17T02:27:36.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.448+0000 7f7682a00640 1 -- 172.21.15.46:0/103698302 learned_addr learned my addr 172.21.15.46:0/103698302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:36.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.449+0000 7f7682a00640 1 -- 172.21.15.46:0/103698302 >> v1:172.21.15.162:6789/0 conn(0x7f76840af1b0 legacy=0x7f76840af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.449+0000 7f7682a00640 1 -- 172.21.15.46:0/103698302 >> v1:172.21.15.46:6789/0 conn(0x7f7684068d40 legacy=0x7f7684069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.449+0000 7f7682a00640 1 -- 172.21.15.46:0/103698302 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76840acba0 con 0x7f76840ac290 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7682a00640 1 --2- 172.21.15.46:0/103698302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f76840ac660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7674009910 tx=0x7f76740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c4aa895a200b5d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7682000640 1 -- 172.21.15.46:0/103698302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674032440 con 0x7f76840ac290 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7682000640 1 -- 172.21.15.46:0/103698302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76740325a0 con 0x7f76840ac290 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7682000640 1 -- 172.21.15.46:0/103698302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674032980 con 0x7f76840ac290 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7683e00640 1 -- 172.21.15.46:0/103698302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 msgr2=0x7f76840ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7683e00640 1 --2- 172.21.15.46:0/103698302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f76840ac660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7674009910 tx=0x7f76740091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7683e00640 1 -- 172.21.15.46:0/103698302 shutdown_connections 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7683e00640 1 --2- 172.21.15.46:0/103698302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f76840ac660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.450+0000 7f7683e00640 1 -- 172.21.15.46:0/103698302 >> 172.21.15.46:0/103698302 conn(0x7f7684096a70 msgr2=0x7f7684096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.451+0000 7f7683e00640 1 -- 172.21.15.46:0/103698302 shutdown_connections 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.451+0000 7f7683e00640 1 -- 172.21.15.46:0/103698302 wait complete. 2024-08-17T02:27:36.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.452+0000 7f7683e00640 1 Processor -- start 2024-08-17T02:27:36.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.452+0000 7f7683e00640 1 -- start start 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 0x7f76840c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f7684099d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840af1b0 0x7f768416c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768409b100 con 0x7f76840ac290 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768409a250 con 0x7f7684068d40 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768409b590 con 0x7f76840af1b0 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f767be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f7684099d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7682a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 0x7f76840c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7682a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 0x7f76840c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:36852/0 (socket says 172.21.15.46:36852) 2024-08-17T02:27:36.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7682a00640 1 -- 172.21.15.46:0/200446036 learned_addr learned my addr 172.21.15.46:0/200446036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:36.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.453+0000 7f7683400640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840af1b0 0x7f768416c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 -- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840af1b0 msgr2=0x7f768416c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840af1b0 0x7f768416c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 -- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 msgr2=0x7f76840c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 0x7f76840c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 -- 172.21.15.46:0/200446036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674009450 con 0x7f76840ac290 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767be00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f7684099d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c4b0 tx=0x7f766c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c011590 con 0x7f76840ac290 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0116f0 con 0x7f76840ac290 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768409a4f0 con 0x7f76840ac290 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c011ab0 con 0x7f76840ac290 2024-08-17T02:27:36.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.454+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768409aab0 con 0x7f76840ac290 2024-08-17T02:27:36.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.456+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7684071050 con 0x7f76840ac290 2024-08-17T02:27:36.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.456+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f766c01b3b0 con 0x7f76840ac290 2024-08-17T02:27:36.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.457+0000 7f767a000640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 0x7f7660067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.457+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f766c0814c0 con 0x7f76840ac290 2024-08-17T02:27:36.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.457+0000 7f7682a00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 0x7f7660067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.458+0000 7f7682a00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 0x7f7660067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7674009910 tx=0x7f7674032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.461+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f766c04f9c0 con 0x7f76840ac290 2024-08-17T02:27:36.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:36.646+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f76840ac070 con 0x7f76840ac290 2024-08-17T02:27:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.203+0000 7f767a000640 1 -- 172.21.15.46:0/200446036 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f766c017070 con 0x7f76840ac290 2024-08-17T02:27:37.204 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 msgr2=0x7f7660067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 0x7f7660067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7674009910 tx=0x7f7674032000 comp rx=0 tx=0).stop 2024-08-17T02:27:37.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 msgr2=0x7f7684099d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f7684099d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f766c00c4b0 tx=0x7f766c007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 shutdown_connections 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f76600650c0 0x7f7660067570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840af1b0 0x7f768416c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76840ac290 0x7f7684099d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 --2- 172.21.15.46:0/200446036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7684068d40 0x7f76840c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 >> 172.21.15.46:0/200446036 conn(0x7f7684096a70 msgr2=0x7f768406b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 shutdown_connections 2024-08-17T02:27:37.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.206+0000 7f7683e00640 1 -- 172.21.15.46:0/200446036 wait complete. 2024-08-17T02:27:37.227 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.383+0000 7f2840e00640 1 Processor -- start 2024-08-17T02:27:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.383+0000 7f2840e00640 1 -- start start 2024-08-17T02:27:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f283c0adc00 0x7f283c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f283c0b59f0 0x7f283c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0b0ad0 0x7f283c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0b1490 con 0x7f283c0b59f0 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0b0030 con 0x7f283c0adc00 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.384+0000 7f2840e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0aefc0 con 0x7f283c0b0ad0 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f283c0b59f0 0x7f283c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f283c0adc00 0x7f283c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f283a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0b0ad0 0x7f283c0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f283c0b59f0 0x7f283c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48862/0 (socket says 172.21.15.46:48862) 2024-08-17T02:27:37.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 -- 172.21.15.46:0/370588642 learned_addr learned my addr 172.21.15.46:0/370588642 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 -- 172.21.15.46:0/370588642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0b0ad0 msgr2=0x7f283c0b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 --2- 172.21.15.46:0/370588642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0b0ad0 0x7f283c0b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 -- 172.21.15.46:0/370588642 >> v2:172.21.15.162:3300/0 conn(0x7f283c0adc00 msgr2=0x7f283c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 --2- 172.21.15.46:0/370588642 >> v2:172.21.15.162:3300/0 conn(0x7f283c0adc00 0x7f283c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.385+0000 7f2839400640 1 -- 172.21.15.46:0/370588642 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0af2a0 con 0x7f283c0b59f0 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.386+0000 7f2839400640 1 --2- 172.21.15.46:0/370588642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c0b3220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f283c070850 tx=0x7f28280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40238d8cbbb7dd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.386+0000 7f2838a00640 1 -- 172.21.15.46:0/370588642 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282802ad40 con 0x7f283c0b59f0 2024-08-17T02:27:37.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.386+0000 7f2838a00640 1 -- 172.21.15.46:0/370588642 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2828032440 con 0x7f283c0b59f0 2024-08-17T02:27:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.386+0000 7f2838a00640 1 -- 172.21.15.46:0/370588642 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282802aea0 con 0x7f283c0b59f0 2024-08-17T02:27:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 -- 172.21.15.46:0/370588642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 msgr2=0x7f283c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 --2- 172.21.15.46:0/370588642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c0b3220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f283c070850 tx=0x7f28280091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 -- 172.21.15.46:0/370588642 shutdown_connections 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 --2- 172.21.15.46:0/370588642 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0b0ad0 0x7f283c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 --2- 172.21.15.46:0/370588642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c0b3220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 --2- 172.21.15.46:0/370588642 >> v2:172.21.15.162:3300/0 conn(0x7f283c0adc00 0x7f283c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 -- 172.21.15.46:0/370588642 >> 172.21.15.46:0/370588642 conn(0x7f283c0cfdb0 msgr2=0x7f283c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 -- 172.21.15.46:0/370588642 shutdown_connections 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.387+0000 7f2840e00640 1 -- 172.21.15.46:0/370588642 wait complete. 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.388+0000 7f2840e00640 1 Processor -- start 2024-08-17T02:27:37.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 -- start start 2024-08-17T02:27:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 0x7f283c1476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c153250 con 0x7f283c0b59f0 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c16a150 con 0x7f283c0b0ad0 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.389+0000 7f2840e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1534a0 con 0x7f283c0adc00 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:58884/0 (socket says 172.21.15.46:58884) 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839e00640 1 -- 172.21.15.46:0/3568592369 learned_addr learned my addr 172.21.15.46:0/3568592369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:37.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839400640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 0x7f283c1476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 -- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 msgr2=0x7f283c169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 -- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 msgr2=0x7f283c1476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 0x7f283c1476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 -- 172.21.15.46:0/3568592369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828009450 con 0x7f283c0b59f0 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f2839400640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 0x7f283c1476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.390+0000 7f283a800640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c15ad40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283400ecc0 tx=0x7f283400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.391+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283400cb30 con 0x7f283c0b59f0 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.391+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283400f040 con 0x7f283c0b59f0 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.391+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834014480 con 0x7f283c0b59f0 2024-08-17T02:27:37.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.391+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c153780 con 0x7f283c0b59f0 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.391+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c153d40 con 0x7f283c0b59f0 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.392+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c0710c0 con 0x7f283c0b59f0 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.393+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f2834014a80 con 0x7f283c0b59f0 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.394+0000 7f2831600640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 0x7f281c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:37.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.394+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f2834082f20 con 0x7f283c0b59f0 2024-08-17T02:27:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.394+0000 7f2839e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 0x7f281c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:37.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.395+0000 7f2839e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 0x7f281c067570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283c09c090 tx=0x7f282c0090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:37.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.398+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2834051370 con 0x7f283c0b59f0 2024-08-17T02:27:37.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.581+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f283c159040 con 0x7f283c0b59f0 2024-08-17T02:27:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:37.932+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2834051740 con 0x7f283c0b59f0 2024-08-17T02:27:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.206+0000 7f2831600640 1 -- 172.21.15.46:0/3568592369 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f283407ef70 con 0x7f283c0b59f0 2024-08-17T02:27:38.208 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-08-17T02:27:38.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 msgr2=0x7f281c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 0x7f281c067570 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283c09c090 tx=0x7f282c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 msgr2=0x7f283c15ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c15ad40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283400ecc0 tx=0x7f283400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 shutdown_connections 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f283c0b59f0 0x7f283c15ad40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f283c0b0ad0 0x7f283c1476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f281c0650c0 0x7f281c067570 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 --2- 172.21.15.46:0/3568592369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c0adc00 0x7f283c169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.215+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 >> 172.21.15.46:0/3568592369 conn(0x7f283c0cfdb0 msgr2=0x7f283c0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.217+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 shutdown_connections 2024-08-17T02:27:38.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.217+0000 7f2840e00640 1 -- 172.21.15.46:0/3568592369 wait complete. 2024-08-17T02:27:38.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:38.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.402+0000 7f3d2a800640 1 Processor -- start 2024-08-17T02:27:38.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.402+0000 7f3d2a800640 1 -- start start 2024-08-17T02:27:38.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.403+0000 7f3d2a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3d240d0890 0x7f3d240b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.403+0000 7f3d2a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.403+0000 7f3d2a800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240afbb0 con 0x7f3d2415c2f0 2024-08-17T02:27:38.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.403+0000 7f3d2a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240b1e10 con 0x7f3d240d0890 2024-08-17T02:27:38.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.403+0000 7f3d2a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240b11d0 con 0x7f3d240b0d50 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d23e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:58894/0 (socket says 172.21.15.46:58894) 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d23e00640 1 -- 172.21.15.46:0/1774052741 learned_addr learned my addr 172.21.15.46:0/1774052741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d23400640 1 --1- 172.21.15.46:0/1774052741 >> v1:172.21.15.162:6789/0 conn(0x7f3d2415c2f0 0x7f3d240af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:56558/0 (socket says 172.21.15.46:56558) 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22a00640 1 --2- 172.21.15.46:0/1774052741 >> v2:172.21.15.162:3300/0 conn(0x7f3d240d0890 0x7f3d240b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22000640 1 -- 172.21.15.46:0/1774052741 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661192498 0 0) 0x7f3d240afbb0 con 0x7f3d2415c2f0 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22000640 1 -- 172.21.15.46:0/1774052741 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d080034e0 con 0x7f3d2415c2f0 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22a00640 1 -- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 msgr2=0x7f3d240b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22a00640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22a00640 1 -- 172.21.15.46:0/1774052741 >> v1:172.21.15.162:6789/0 conn(0x7f3d2415c2f0 legacy=0x7f3d240af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d22a00640 1 -- 172.21.15.46:0/1774052741 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240afe90 con 0x7f3d240d0890 2024-08-17T02:27:38.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.404+0000 7f3d23e00640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.405+0000 7f3d22a00640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d240d0890 0x7f3d240b0810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009880 tx=0x7f3d100090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=994fd9d02d8d1093 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d22000640 1 -- 172.21.15.46:0/1774052741 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1002ad90 con 0x7f3d240d0890 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d22000640 1 -- 172.21.15.46:0/1774052741 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10032440 con 0x7f3d240d0890 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d22000640 1 -- 172.21.15.46:0/1774052741 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10032820 con 0x7f3d240d0890 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 -- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d240d0890 msgr2=0x7f3d240b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d240d0890 0x7f3d240b0810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009880 tx=0x7f3d100090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 -- 172.21.15.46:0/1774052741 shutdown_connections 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240b0d50 0x7f3d240b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 --2- 172.21.15.46:0/1774052741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d240d0890 0x7f3d240b0810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 -- 172.21.15.46:0/1774052741 >> 172.21.15.46:0/1774052741 conn(0x7f3d240cfdb0 msgr2=0x7f3d240d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:38.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 -- 172.21.15.46:0/1774052741 shutdown_connections 2024-08-17T02:27:38.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.406+0000 7f3d2a800640 1 -- 172.21.15.46:0/1774052741 wait complete. 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.408+0000 7f3d2a800640 1 Processor -- start 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.408+0000 7f3d2a800640 1 -- start start 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240d0890 0x7f3d241696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 0x7f3d240ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24169c10 con 0x7f3d240b0d50 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240ce230 con 0x7f3d2415c2f0 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d2a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24157460 con 0x7f3d240d0890 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48874/0 (socket says 172.21.15.46:48874) 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 -- 172.21.15.46:0/3575666744 learned_addr learned my addr 172.21.15.46:0/3575666744 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d22a00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240d0890 0x7f3d241696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23e00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 0x7f3d240ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 -- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240d0890 msgr2=0x7f3d241696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240d0890 0x7f3d241696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 -- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 msgr2=0x7f3d240ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 0x7f3d240ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:38.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23400640 1 -- 172.21.15.46:0/3575666744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c009ae0 con 0x7f3d240b0d50 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.409+0000 7f3d23e00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 0x7f3d240ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d23400640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c4e0 tx=0x7f3d14007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140072e0 con 0x7f3d240b0d50 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14007440 con 0x7f3d240b0d50 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140049d0 con 0x7f3d240b0d50 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10009390 con 0x7f3d240b0d50 2024-08-17T02:27:38.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.410+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d240cd900 con 0x7f3d240b0d50 2024-08-17T02:27:38.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.411+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d24071050 con 0x7f3d240b0d50 2024-08-17T02:27:38.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.412+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3d14013400 con 0x7f3d240b0d50 2024-08-17T02:27:38.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.413+0000 7f3d1aa00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 0x7f3d04067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:38.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.413+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3d14081770 con 0x7f3d240b0d50 2024-08-17T02:27:38.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.413+0000 7f3d22a00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 0x7f3d04067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:38.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.414+0000 7f3d22a00640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 0x7f3d04067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d10034000 tx=0x7f3d10032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:38.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.417+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3d1404be40 con 0x7f3d240b0d50 2024-08-17T02:27:38.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:38.636+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d240899a0 con 0x7f3d240b0d50 2024-08-17T02:27:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.208+0000 7f3d1aa00640 1 -- 172.21.15.46:0/3575666744 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3d1404f8a0 con 0x7f3d240b0d50 2024-08-17T02:27:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 msgr2=0x7f3d04067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 0x7f3d04067630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d10034000 tx=0x7f3d10032000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 msgr2=0x7f3d24146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400c4e0 tx=0x7f3d14007d40 comp rx=0 tx=0).stop 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 shutdown_connections 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d2415c2f0 0x7f3d240ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d04065180 0x7f3d04067630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d240d0890 0x7f3d241696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 --2- 172.21.15.46:0/3575666744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d240b0d50 0x7f3d24146930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 >> 172.21.15.46:0/3575666744 conn(0x7f3d240cfdb0 msgr2=0x7f3d240b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 shutdown_connections 2024-08-17T02:27:39.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.210+0000 7f3d2a800640 1 -- 172.21.15.46:0/3575666744 wait complete. 2024-08-17T02:27:39.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:39.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.380+0000 7fcf77e00640 1 Processor -- start 2024-08-17T02:27:39.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.381+0000 7fcf77e00640 1 -- start start 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf77e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf780cbea0 0x7fcf78156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf77e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcf7806dc80 0x7fcf781577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf77e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780cc300 con 0x7fcf78156ad0 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf77e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780ca900 con 0x7fcf780cbea0 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf77e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780cc560 con 0x7fcf7806dc80 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf6fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf780cbea0 0x7fcf78156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf6fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcf780cbea0 0x7fcf78156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48886/0 (socket says 172.21.15.46:48886) 2024-08-17T02:27:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.382+0000 7fcf6fe00640 1 -- 172.21.15.46:0/2522833110 learned_addr learned my addr 172.21.15.46:0/2522833110 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.383+0000 7fcf77400640 1 --2- 172.21.15.46:0/2522833110 >> v2:172.21.15.162:3300/0 conn(0x7fcf7806dc80 0x7fcf781577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.383+0000 7fcf6fe00640 1 -- 172.21.15.46:0/2522833110 >> v2:172.21.15.162:3300/0 conn(0x7fcf7806dc80 msgr2=0x7fcf781577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.383+0000 7fcf6fe00640 1 --2- 172.21.15.46:0/2522833110 >> v2:172.21.15.162:3300/0 conn(0x7fcf7806dc80 0x7fcf781577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.383+0000 7fcf6fe00640 1 -- 172.21.15.46:0/2522833110 >> v1:172.21.15.162:6789/0 conn(0x7fcf78156ad0 legacy=0x7fcf7806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.383+0000 7fcf6fe00640 1 -- 172.21.15.46:0/2522833110 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780caaf0 con 0x7fcf780cbea0 2024-08-17T02:27:39.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.384+0000 7fcf6fe00640 1 --2- 172.21.15.46:0/2522833110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf78156ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf7806c330 tx=0x7fcf600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f4693bf481e19b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.384+0000 7fcf76000640 1 -- 172.21.15.46:0/2522833110 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6002ae80 con 0x7fcf780cbea0 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.384+0000 7fcf76000640 1 -- 172.21.15.46:0/2522833110 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60032440 con 0x7fcf780cbea0 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.384+0000 7fcf76000640 1 -- 172.21.15.46:0/2522833110 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60032800 con 0x7fcf780cbea0 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 -- 172.21.15.46:0/2522833110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 msgr2=0x7fcf78156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 --2- 172.21.15.46:0/2522833110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf78156ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf7806c330 tx=0x7fcf600091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 -- 172.21.15.46:0/2522833110 shutdown_connections 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 --2- 172.21.15.46:0/2522833110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf78156ea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 --2- 172.21.15.46:0/2522833110 >> v2:172.21.15.162:3300/0 conn(0x7fcf7806dc80 0x7fcf781577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 -- 172.21.15.46:0/2522833110 >> 172.21.15.46:0/2522833110 conn(0x7fcf78067750 msgr2=0x7fcf780cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 -- 172.21.15.46:0/2522833110 shutdown_connections 2024-08-17T02:27:39.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.385+0000 7fcf77e00640 1 -- 172.21.15.46:0/2522833110 wait complete. 2024-08-17T02:27:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.386+0000 7fcf77e00640 1 Processor -- start 2024-08-17T02:27:39.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.386+0000 7fcf77e00640 1 -- start start 2024-08-17T02:27:39.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf7806dc80 0x7fcf780c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 0x7fcf7815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780c7d30 con 0x7fcf780cbea0 2024-08-17T02:27:39.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780c5360 con 0x7fcf78156ad0 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780c2620 con 0x7fcf7806dc80 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48894/0 (socket says 172.21.15.46:48894) 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf6fe00640 1 -- 172.21.15.46:0/1318961176 learned_addr learned my addr 172.21.15.46:0/1318961176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.387+0000 7fcf77400640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 0x7fcf7815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf76a00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf7806dc80 0x7fcf780c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 -- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf7806dc80 msgr2=0x7fcf780c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf7806dc80 0x7fcf780c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 -- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 msgr2=0x7fcf7815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 0x7fcf7815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 -- 172.21.15.46:0/1318961176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf60009450 con 0x7fcf780cbea0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf77400640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 0x7fcf7815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6fe00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009940 tx=0x7fcf60032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60000d10 con 0x7fcf780cbea0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60031de0 con 0x7fcf780cbea0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6003d690 con 0x7fcf780cbea0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.388+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780c7a50 con 0x7fcf780cbea0 2024-08-17T02:27:39.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.389+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780c22b0 con 0x7fcf780cbea0 2024-08-17T02:27:39.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.389+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf78071050 con 0x7fcf780cbea0 2024-08-17T02:27:39.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.390+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf60039040 con 0x7fcf780cbea0 2024-08-17T02:27:39.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.391+0000 7fcf6e000640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 0x7fcf54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.391+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf600a2800 con 0x7fcf780cbea0 2024-08-17T02:27:39.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.392+0000 7fcf76a00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 0x7fcf54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.392+0000 7fcf76a00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 0x7fcf54067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf68003720 tx=0x7fcf68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.395+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf60070820 con 0x7fcf780cbea0 2024-08-17T02:27:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.578+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf78155f70 con 0x7fcf780cbea0 2024-08-17T02:27:39.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.579+0000 7fcf6e000640 1 -- 172.21.15.46:0/1318961176 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fcf60042090 con 0x7fcf780cbea0 2024-08-17T02:27:39.580 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:39.580 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:38.637900+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 msgr2=0x7fcf54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 0x7fcf54067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf68003720 tx=0x7fcf68009040 comp rx=0 tx=0).stop 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 msgr2=0x7fcf780c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009940 tx=0x7fcf60032000 comp rx=0 tx=0).stop 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 shutdown_connections 2024-08-17T02:27:39.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf78156ad0 0x7fcf7815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf780cbea0 0x7fcf780c4e20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcf54065150 0x7fcf54067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 --2- 172.21.15.46:0/1318961176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf7806dc80 0x7fcf780c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 >> 172.21.15.46:0/1318961176 conn(0x7fcf78067750 msgr2=0x7fcf78068560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 shutdown_connections 2024-08-17T02:27:39.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.581+0000 7fcf77e00640 1 -- 172.21.15.46:0/1318961176 wait complete. 2024-08-17T02:27:39.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:39.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.746+0000 7f4bbb800640 1 Processor -- start 2024-08-17T02:27:39.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.746+0000 7f4bbb800640 1 -- start start 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bbb800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 0x7f4bb406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bbb800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bb415c600 0x7f4bb406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bbb800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb406b9d0 con 0x7f4bb4066cd0 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bbb800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb40aad80 con 0x7f4bb415c600 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bbb800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb40ab060 con 0x7f4bb415c230 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bb3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bb415c600 0x7f4bb406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bb3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4bb415c600 0x7f4bb406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48910/0 (socket says 172.21.15.46:48910) 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bb3e00640 1 -- 172.21.15.46:0/1738614903 learned_addr learned my addr 172.21.15.46:0/1738614903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.747+0000 7f4bb8e00640 1 --2- 172.21.15.46:0/1738614903 >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 0x7f4bb406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.748+0000 7f4bb3e00640 1 -- 172.21.15.46:0/1738614903 >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 msgr2=0x7f4bb406be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.748+0000 7f4bb3e00640 1 --2- 172.21.15.46:0/1738614903 >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 0x7f4bb406be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.748+0000 7f4bb3e00640 1 -- 172.21.15.46:0/1738614903 >> v1:172.21.15.162:6789/0 conn(0x7f4bb4066cd0 legacy=0x7f4bb40670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.748+0000 7f4bb3e00640 1 -- 172.21.15.46:0/1738614903 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb406b380 con 0x7f4bb415c600 2024-08-17T02:27:39.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.748+0000 7f4bb8e00640 1 --2- 172.21.15.46:0/1738614903 >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 0x7f4bb406be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:39.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bb3e00640 1 --2- 172.21.15.46:0/1738614903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb406e4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406c680 tx=0x7f4ba00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47db1de665a4e86f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bb3400640 1 -- 172.21.15.46:0/1738614903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba002ae80 con 0x7f4bb415c600 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bb3400640 1 -- 172.21.15.46:0/1738614903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba0032440 con 0x7f4bb415c600 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bb3400640 1 -- 172.21.15.46:0/1738614903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0032800 con 0x7f4bb415c600 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bbb800640 1 -- 172.21.15.46:0/1738614903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 msgr2=0x7f4bb406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.749+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1738614903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb406e4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406c680 tx=0x7f4ba00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 -- 172.21.15.46:0/1738614903 shutdown_connections 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1738614903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb406e4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1738614903 >> v2:172.21.15.162:3300/0 conn(0x7f4bb415c230 0x7f4bb406be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 -- 172.21.15.46:0/1738614903 >> 172.21.15.46:0/1738614903 conn(0x7f4bb406d8f0 msgr2=0x7f4bb406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 -- 172.21.15.46:0/1738614903 shutdown_connections 2024-08-17T02:27:39.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.750+0000 7f4bbb800640 1 -- 172.21.15.46:0/1738614903 wait complete. 2024-08-17T02:27:39.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.751+0000 7f4bbb800640 1 Processor -- start 2024-08-17T02:27:39.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.751+0000 7f4bbb800640 1 -- start start 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb4066cd0 0x7f4bb40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bb415c230 0x7f4bb41436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4143c30 con 0x7f4bb415c600 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40caf00 con 0x7f4bb4066cd0 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bbb800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb40cc3a0 con 0x7f4bb415c230 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bb9800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bb9800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48920/0 (socket says 172.21.15.46:48920) 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bb9800640 1 -- 172.21.15.46:0/1332130521 learned_addr learned my addr 172.21.15.46:0/1332130521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bb8e00640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb4066cd0 0x7f4bb40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.752+0000 7f4bb3e00640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bb415c230 0x7f4bb41436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 -- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bb415c230 msgr2=0x7f4bb41436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bb415c230 0x7f4bb41436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 -- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb4066cd0 msgr2=0x7f4bb40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb4066cd0 0x7f4bb40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 -- 172.21.15.46:0/1332130521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0009450 con 0x7f4bb415c600 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bb9800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c860 tx=0x7f4bac001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00ce50 con 0x7f4bb415c600 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac00a850 con 0x7f4bb415c600 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00ac10 con 0x7f4bb415c600 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb40ca2f0 con 0x7f4bb415c600 2024-08-17T02:27:39.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.753+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb40ca8b0 con 0x7f4bb415c600 2024-08-17T02:27:39.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.754+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb40cb090 con 0x7f4bb415c600 2024-08-17T02:27:39.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.755+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4bac012630 con 0x7f4bb415c600 2024-08-17T02:27:39.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.756+0000 7f4ba7e00640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 0x7f4b94067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:39.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.756+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bac082600 con 0x7f4bb415c600 2024-08-17T02:27:39.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.756+0000 7f4bb8e00640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 0x7f4b94067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:39.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.757+0000 7f4bb8e00640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 0x7f4b94067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8006e70 tx=0x7f4ba8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:39.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.760+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4bac0506d0 con 0x7f4bb415c600 2024-08-17T02:27:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.943+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb4064db0 con 0x7f4bb415c600 2024-08-17T02:27:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.944+0000 7f4ba7e00640 1 -- 172.21.15.46:0/1332130521 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4bac053cf0 con 0x7f4bb415c600 2024-08-17T02:27:39.945 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:39.945 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:39.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 msgr2=0x7f4b94067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 0x7f4b94067630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8006e70 tx=0x7f4ba8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 msgr2=0x7f4bb40cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00c860 tx=0x7f4bac001690 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 shutdown_connections 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4bb415c600 0x7f4bb40cbe60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4b94065180 0x7f4b94067630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4bb415c230 0x7f4bb41436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 --2- 172.21.15.46:0/1332130521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bb4066cd0 0x7f4bb40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 >> 172.21.15.46:0/1332130521 conn(0x7f4bb406d8f0 msgr2=0x7f4bb40afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.946+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 shutdown_connections 2024-08-17T02:27:39.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:39.947+0000 7f4bbb800640 1 -- 172.21.15.46:0/1332130521 wait complete. 2024-08-17T02:27:39.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:40.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.114+0000 7f2ec0a00640 1 Processor -- start 2024-08-17T02:27:40.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.115+0000 7f2ec0a00640 1 -- start start 2024-08-17T02:27:40.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ec0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 0x7f2ebc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ec0a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ebc0c4950 0x7f2ebc0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ec0a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0c5a40 con 0x7f2ebc0cb980 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ec0a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b2eb0 con 0x7f2ebc0c4950 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ec0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0c4e30 con 0x7f2ebc0ce250 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2eb1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ebc0c4950 0x7f2ebc0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2eb1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f2ebc0c4950 0x7f2ebc0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40314/0 (socket says 172.21.15.46:40314) 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2eb1e00640 1 -- 172.21.15.46:0/4089526983 learned_addr learned my addr 172.21.15.46:0/4089526983 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2ebb200640 1 --1- 172.21.15.46:0/4089526983 >> v1:172.21.15.46:6789/0 conn(0x7f2ebc0cb980 0x7f2ebc158730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38604/0 (socket says 172.21.15.46:38604) 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.116+0000 7f2eba800640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 0x7f2ebc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eb1e00640 1 -- 172.21.15.46:0/4089526983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 msgr2=0x7f2ebc0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eb1e00640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 0x7f2ebc0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eb1e00640 1 -- 172.21.15.46:0/4089526983 >> v1:172.21.15.46:6789/0 conn(0x7f2ebc0cb980 legacy=0x7f2ebc158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eb1e00640 1 -- 172.21.15.46:0/4089526983 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0c5110 con 0x7f2ebc0c4950 2024-08-17T02:27:40.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eb9e00640 1 -- 172.21.15.46:0/4089526983 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571516846 0 0) 0x7f2ebc0c5a40 con 0x7f2ebc0cb980 2024-08-17T02:27:40.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.117+0000 7f2eba800640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 0x7f2ebc0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2eb1e00640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0c4950 0x7f2ebc0b2970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009910 tx=0x7f2ea40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a23e4ce6c7d183 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2eb9e00640 1 -- 172.21.15.46:0/4089526983 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea402adb0 con 0x7f2ebc0c4950 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2eb9e00640 1 -- 172.21.15.46:0/4089526983 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4032440 con 0x7f2ebc0c4950 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2eb9e00640 1 -- 172.21.15.46:0/4089526983 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40327e0 con 0x7f2ebc0c4950 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2ec0a00640 1 -- 172.21.15.46:0/4089526983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0c4950 msgr2=0x7f2ebc0b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.118+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0c4950 0x7f2ebc0b2970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009910 tx=0x7f2ea40091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 -- 172.21.15.46:0/4089526983 shutdown_connections 2024-08-17T02:27:40.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0c4950 0x7f2ebc0b2970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/4089526983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0ce250 0x7f2ebc0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 -- 172.21.15.46:0/4089526983 >> 172.21.15.46:0/4089526983 conn(0x7f2ebc098e30 msgr2=0x7f2ebc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 -- 172.21.15.46:0/4089526983 shutdown_connections 2024-08-17T02:27:40.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.119+0000 7f2ec0a00640 1 -- 172.21.15.46:0/4089526983 wait complete. 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.120+0000 7f2ec0a00640 1 Processor -- start 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.120+0000 7f2ec0a00640 1 -- start start 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0c4950 0x7f2ebc0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 0x7f2ebc144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0c9120 con 0x7f2ebc0cb980 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0c8510 con 0x7f2ebc0ce250 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2ec0a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0c87f0 con 0x7f2ebc0c4950 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2eb1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2eb1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40328/0 (socket says 172.21.15.46:40328) 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.121+0000 7f2eb1e00640 1 -- 172.21.15.46:0/2750749052 learned_addr learned my addr 172.21.15.46:0/2750749052 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eba800640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0c4950 0x7f2ebc0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2ebb200640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 0x7f2ebc144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 -- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0c4950 msgr2=0x7f2ebc0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0c4950 0x7f2ebc0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 -- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 msgr2=0x7f2ebc144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 0x7f2ebc144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 -- 172.21.15.46:0/2750749052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009450 con 0x7f2ebc0cb980 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2ebb200640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 0x7f2ebc144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:40.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb1e00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4035040 tx=0x7f2ea4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4032880 con 0x7f2ebc0cb980 2024-08-17T02:27:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.122+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4031a60 con 0x7f2ebc0cb980 2024-08-17T02:27:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.123+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4031e20 con 0x7f2ebc0cb980 2024-08-17T02:27:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.123+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0c8ad0 con 0x7f2ebc0cb980 2024-08-17T02:27:40.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.123+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc0c81d0 con 0x7f2ebc0cb980 2024-08-17T02:27:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.124+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc071050 con 0x7f2ebc0cb980 2024-08-17T02:27:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.125+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2ea4039040 con 0x7f2ebc0cb980 2024-08-17T02:27:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.126+0000 7f2eb2a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 0x7f2e98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:40.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.126+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ea40a1fc0 con 0x7f2ebc0cb980 2024-08-17T02:27:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.126+0000 7f2eba800640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 0x7f2e98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:40.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.127+0000 7f2eba800640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 0x7f2e98067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00bc80 tx=0x7f2eac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:40.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.130+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2ea40d3e40 con 0x7f2ebc0cb980 2024-08-17T02:27:40.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:40.350+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2ebc067cb0 con 0x7f2ebc0cb980 2024-08-17T02:27:41.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.215+0000 7f2eb2a00640 1 -- 172.21.15.46:0/2750749052 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ea40370b0 con 0x7f2ebc0cb980 2024-08-17T02:27:41.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 msgr2=0x7f2e98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 0x7f2e98067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00bc80 tx=0x7f2eac008040 comp rx=0 tx=0).stop 2024-08-17T02:27:41.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 msgr2=0x7f2ebc0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4035040 tx=0x7f2ea4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 shutdown_connections 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ebc0ce250 0x7f2ebc144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ebc0cb980 0x7f2ebc0c7c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2e98065150 0x7f2e98067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 --2- 172.21.15.46:0/2750749052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ebc0c4950 0x7f2ebc0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 >> 172.21.15.46:0/2750749052 conn(0x7f2ebc098e30 msgr2=0x7f2ebc068560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 shutdown_connections 2024-08-17T02:27:41.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.218+0000 7f2ec0a00640 1 -- 172.21.15.46:0/2750749052 wait complete. 2024-08-17T02:27:41.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:41.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.394+0000 7ff0f3600640 1 Processor -- start 2024-08-17T02:27:41.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.394+0000 7ff0f3600640 1 -- start start 2024-08-17T02:27:41.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.395+0000 7ff0f3600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.395+0000 7ff0f3600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 0x7ff0ec0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.395+0000 7ff0f3600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec1598f0 con 0x7ff0ec155a80 2024-08-17T02:27:41.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.395+0000 7ff0f3600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec159bd0 con 0x7ff0ec155e50 2024-08-17T02:27:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.395+0000 7ff0f3600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec159eb0 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42574/0 (socket says 172.21.15.46:42574) 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 -- 172.21.15.46:0/2570727364 learned_addr learned my addr 172.21.15.46:0/2570727364 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0f1600640 1 --2- 172.21.15.46:0/2570727364 >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 0x7ff0ec0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0f0c00640 1 --1- 172.21.15.46:0/2570727364 >> v1:172.21.15.162:6789/0 conn(0x7ff0ec155a80 0x7ff0ec06dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45906/0 (socket says 172.21.15.46:45906) 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 -- 172.21.15.46:0/2570727364 >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 msgr2=0x7ff0ec0c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 --2- 172.21.15.46:0/2570727364 >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 0x7ff0ec0c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 -- 172.21.15.46:0/2570727364 >> v1:172.21.15.162:6789/0 conn(0x7ff0ec155a80 legacy=0x7ff0ec06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0ebe00640 1 -- 172.21.15.46:0/2570727364 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec15a190 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.396+0000 7ff0f1600640 1 --2- 172.21.15.46:0/2570727364 >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 0x7ff0ec0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.397+0000 7ff0ebe00640 1 --2- 172.21.15.46:0/2570727364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800bbc0 tx=0x7ff0d800b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a4c37651a9f1dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.398+0000 7ff0eb400640 1 -- 172.21.15.46:0/2570727364 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8031610 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.398+0000 7ff0eb400640 1 -- 172.21.15.46:0/2570727364 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8031770 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.398+0000 7ff0eb400640 1 -- 172.21.15.46:0/2570727364 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8031b50 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.398+0000 7ff0f3600640 1 -- 172.21.15.46:0/2570727364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 msgr2=0x7ff0ec0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.398+0000 7ff0f3600640 1 --2- 172.21.15.46:0/2570727364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800bbc0 tx=0x7ff0d800b460 comp rx=0 tx=0).stop 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 -- 172.21.15.46:0/2570727364 shutdown_connections 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 --2- 172.21.15.46:0/2570727364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec0c7db0 0x7ff0ec0c8bd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 --2- 172.21.15.46:0/2570727364 >> v2:172.21.15.162:3300/0 conn(0x7ff0ec155e50 0x7ff0ec0c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 -- 172.21.15.46:0/2570727364 >> 172.21.15.46:0/2570727364 conn(0x7ff0ec067750 msgr2=0x7ff0ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 -- 172.21.15.46:0/2570727364 shutdown_connections 2024-08-17T02:27:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.399+0000 7ff0f3600640 1 -- 172.21.15.46:0/2570727364 wait complete. 2024-08-17T02:27:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.400+0000 7ff0f3600640 1 Processor -- start 2024-08-17T02:27:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.400+0000 7ff0f3600640 1 -- start start 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0ec155a80 0x7ff0ec15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec155e50 0x7ff0ec15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec15db10 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec1571c0 con 0x7ff0ec155a80 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f3600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec156890 con 0x7ff0ec155e50 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40344/0 (socket says 172.21.15.46:40344) 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f0c00640 1 -- 172.21.15.46:0/131261316 learned_addr learned my addr 172.21.15.46:0/131261316 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0ebe00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0ec155a80 0x7ff0ec15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.401+0000 7ff0f1600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec155e50 0x7ff0ec15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 -- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec155e50 msgr2=0x7ff0ec15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec155e50 0x7ff0ec15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 -- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0ec155a80 msgr2=0x7ff0ec15d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0ec155a80 0x7ff0ec15d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 -- 172.21.15.46:0/131261316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4009a20 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f0c00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c5c0 tx=0x7ff0e0007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00072e0 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0007440 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00047a0 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d800b700 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.402+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec156e50 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.404+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec071050 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.404+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff0e0004bd0 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.405+0000 7ff0dfe00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 0x7ff0cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.405+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0e0081ba0 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.405+0000 7ff0ebe00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 0x7ff0cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.406+0000 7ff0ebe00640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 0x7ff0cc067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8037000 tx=0x7ff0d803a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:41.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.409+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0e004fc60 con 0x7ff0ec0c7db0 2024-08-17T02:27:41.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:41.629+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff0ec0b0ac0 con 0x7ff0ec0c7db0 2024-08-17T02:27:42.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.217+0000 7ff0dfe00640 1 -- 172.21.15.46:0/131261316 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0e0053280 con 0x7ff0ec0c7db0 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 msgr2=0x7ff0cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 0x7ff0cc067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8037000 tx=0x7ff0d803a000 comp rx=0 tx=0).stop 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 msgr2=0x7ff0ec13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000c5c0 tx=0x7ff0e0007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 shutdown_connections 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0cc065150 0x7ff0cc067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0ec155e50 0x7ff0ec15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0ec155a80 0x7ff0ec15d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 --2- 172.21.15.46:0/131261316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0ec0c7db0 0x7ff0ec13fe70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 >> 172.21.15.46:0/131261316 conn(0x7ff0ec067750 msgr2=0x7ff0ec0c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 shutdown_connections 2024-08-17T02:27:42.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.219+0000 7ff0f3600640 1 -- 172.21.15.46:0/131261316 wait complete. 2024-08-17T02:27:42.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:42.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.387+0000 7fba63200640 1 Processor -- start 2024-08-17T02:27:42.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.387+0000 7fba63200640 1 -- start start 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba63200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba640c5c40 0x7fba640caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba63200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640cc890 con 0x7fba640ce8a0 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba63200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640cb4c0 con 0x7fba640aed50 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba63200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640cb7a0 con 0x7fba640c5c40 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba62800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fba640c5c40 0x7fba640caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba59400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fba640ce8a0 0x7fba640ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38612/0 (socket says 172.21.15.46:38612) 2024-08-17T02:27:42.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.388+0000 7fba59400640 1 -- 172.21.15.46:0/1796103058 learned_addr learned my addr 172.21.15.46:0/1796103058 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.389+0000 7fba62800640 1 -- 172.21.15.46:0/1796103058 >> v1:172.21.15.162:6789/0 conn(0x7fba640aed50 legacy=0x7fba640ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.389+0000 7fba62800640 1 -- 172.21.15.46:0/1796103058 >> v1:172.21.15.46:6789/0 conn(0x7fba640ce8a0 legacy=0x7fba640ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.389+0000 7fba62800640 1 -- 172.21.15.46:0/1796103058 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640cba80 con 0x7fba640c5c40 2024-08-17T02:27:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.389+0000 7fba61400640 1 -- 172.21.15.46:0/1796103058 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930639181 0 0) 0x7fba640cc890 con 0x7fba640ce8a0 2024-08-17T02:27:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.390+0000 7fba62800640 1 --2- 172.21.15.46:0/1796103058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640caec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009e60 tx=0x7fba5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5056d87b29e2dd8f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.390+0000 7fba61400640 1 -- 172.21.15.46:0/1796103058 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c007550 con 0x7fba640c5c40 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.390+0000 7fba61400640 1 -- 172.21.15.46:0/1796103058 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c02d050 con 0x7fba640c5c40 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.390+0000 7fba61400640 1 -- 172.21.15.46:0/1796103058 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c007900 con 0x7fba640c5c40 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 -- 172.21.15.46:0/1796103058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 msgr2=0x7fba640caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 --2- 172.21.15.46:0/1796103058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640caec0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009e60 tx=0x7fba5c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 -- 172.21.15.46:0/1796103058 shutdown_connections 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 --2- 172.21.15.46:0/1796103058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640caec0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 -- 172.21.15.46:0/1796103058 >> 172.21.15.46:0/1796103058 conn(0x7fba64098e30 msgr2=0x7fba6406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 -- 172.21.15.46:0/1796103058 shutdown_connections 2024-08-17T02:27:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.391+0000 7fba63200640 1 -- 172.21.15.46:0/1796103058 wait complete. 2024-08-17T02:27:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.392+0000 7fba63200640 1 Processor -- start 2024-08-17T02:27:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.392+0000 7fba63200640 1 -- start start 2024-08-17T02:27:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba640aed50 0x7fba640b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 0x7fba6416c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b4390 con 0x7fba640c5c40 2024-08-17T02:27:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b3870 con 0x7fba640aed50 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba63200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640b3af0 con 0x7fba640ce8a0 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba59400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba59400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40368/0 (socket says 172.21.15.46:40368) 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.393+0000 7fba59400640 1 -- 172.21.15.46:0/542614729 learned_addr learned my addr 172.21.15.46:0/542614729 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba61e00640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba640aed50 0x7fba640b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba62800640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 0x7fba6416c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 -- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 msgr2=0x7fba6416c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 0x7fba6416c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 -- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba640aed50 msgr2=0x7fba640b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba640aed50 0x7fba640b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 -- 172.21.15.46:0/542614729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009a20 con 0x7fba640c5c40 2024-08-17T02:27:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba62800640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 0x7fba6416c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba59400640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c610 tx=0x7fba4c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c005aa0 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c005c00 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba640b3dd0 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.394+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0070f0 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.395+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba640c6e00 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.396+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64071050 con 0x7fba640c5c40 2024-08-17T02:27:42.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.396+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fba4c007500 con 0x7fba640c5c40 2024-08-17T02:27:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.397+0000 7fba5a000640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 0x7fba40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.397+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba4c081e90 con 0x7fba640c5c40 2024-08-17T02:27:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.398+0000 7fba61e00640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 0x7fba40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.398+0000 7fba61e00640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 0x7fba40067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba54007fd0 tx=0x7fba54007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.401+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fba4c04ff30 con 0x7fba640c5c40 2024-08-17T02:27:42.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.620+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba640b57f0 con 0x7fba640c5c40 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.620+0000 7fba5a000640 1 -- 172.21.15.46:0/542614729 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fba4c053550 con 0x7fba640c5c40 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:42.621 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:42.622 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 msgr2=0x7fba40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 0x7fba40067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba54007fd0 tx=0x7fba54007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 msgr2=0x7fba640b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00c610 tx=0x7fba4c007d00 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 shutdown_connections 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fba40065150 0x7fba40067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba640ce8a0 0x7fba6416c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba640c5c40 0x7fba640b3330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 --2- 172.21.15.46:0/542614729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba640aed50 0x7fba640b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.622+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 >> 172.21.15.46:0/542614729 conn(0x7fba64098e30 msgr2=0x7fba640cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.623+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 shutdown_connections 2024-08-17T02:27:42.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.623+0000 7fba63200640 1 -- 172.21.15.46:0/542614729 wait complete. 2024-08-17T02:27:42.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:42.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.789+0000 7f082a600640 1 Processor -- start 2024-08-17T02:27:42.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.790+0000 7f082a600640 1 -- start start 2024-08-17T02:27:42.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f082a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ca350 0x7f08240cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f082a600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f08240ae1b0 0x7f08240cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f082a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240cb730 con 0x7f08240ca720 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f082a600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08240cf9c0 con 0x7f08240ae1b0 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f082a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240cb0e0 con 0x7f08240ca350 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f08240ae1b0 0x7f08240cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f08240ae1b0 0x7f08240cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40374/0 (socket says 172.21.15.46:40374) 2024-08-17T02:27:42.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 -- 172.21.15.46:0/3866697321 learned_addr learned my addr 172.21.15.46:0/3866697321 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:42.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829200640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ca350 0x7f08240cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 -- 172.21.15.46:0/3866697321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ca350 msgr2=0x7f08240cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:42.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ca350 0x7f08240cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.791+0000 7f0829c00640 1 -- 172.21.15.46:0/3866697321 >> v1:172.21.15.162:6789/0 conn(0x7f08240ca720 legacy=0x7f08240cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.792+0000 7f0829c00640 1 -- 172.21.15.46:0/3866697321 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240cb3c0 con 0x7f08240ae1b0 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f0829c00640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ae1b0 0x7f08240cdff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f081c009f20 tx=0x7f081c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cc41e334c2ec05 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f0823400640 1 -- 172.21.15.46:0/3866697321 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c032450 con 0x7f08240ae1b0 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f0823400640 1 -- 172.21.15.46:0/3866697321 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c0325b0 con 0x7f08240ae1b0 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f0823400640 1 -- 172.21.15.46:0/3866697321 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c032990 con 0x7f08240ae1b0 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 -- 172.21.15.46:0/3866697321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ae1b0 msgr2=0x7f08240cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ae1b0 0x7f08240cdff0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f081c009f20 tx=0x7f081c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 -- 172.21.15.46:0/3866697321 shutdown_connections 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ae1b0 0x7f08240cdff0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 --2- 172.21.15.46:0/3866697321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ca350 0x7f08240cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.793+0000 7f082a600640 1 -- 172.21.15.46:0/3866697321 >> 172.21.15.46:0/3866697321 conn(0x7f08240cfdb0 msgr2=0x7f08240d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.794+0000 7f082a600640 1 -- 172.21.15.46:0/3866697321 shutdown_connections 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.794+0000 7f082a600640 1 -- 172.21.15.46:0/3866697321 wait complete. 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.795+0000 7f082a600640 1 Processor -- start 2024-08-17T02:27:42.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.795+0000 7f082a600640 1 -- start start 2024-08-17T02:27:42.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ae1b0 0x7f08240c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08240ca720 0x7f08240afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240c8380 con 0x7f08240ca350 2024-08-17T02:27:42.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240c6dc0 con 0x7f08240ca720 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f082a600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240c7080 con 0x7f08240ae1b0 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f0823e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f0823e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40386/0 (socket says 172.21.15.46:40386) 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f0823e00640 1 -- 172.21.15.46:0/2190506860 learned_addr learned my addr 172.21.15.46:0/2190506860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f0829200640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ae1b0 0x7f08240c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.796+0000 7f0829c00640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08240ca720 0x7f08240afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 -- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ae1b0 msgr2=0x7f08240c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ae1b0 0x7f08240c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 -- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08240ca720 msgr2=0x7f08240afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08240ca720 0x7f08240afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 -- 172.21.15.46:0/2190506860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c009ae0 con 0x7f08240ca350 2024-08-17T02:27:42.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0823e00640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081000c4c0 tx=0x7f0810007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011590 con 0x7f08240ca350 2024-08-17T02:27:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810011710 con 0x7f08240ca350 2024-08-17T02:27:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810011ad0 con 0x7f08240ca350 2024-08-17T02:27:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08240c7360 con 0x7f08240ca350 2024-08-17T02:27:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.797+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08240c7920 con 0x7f08240ca350 2024-08-17T02:27:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.798+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824071050 con 0x7f08240ca350 2024-08-17T02:27:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.799+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f081001b3b0 con 0x7f08240ca350 2024-08-17T02:27:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.800+0000 7f0817e00640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.800+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0810081960 con 0x7f08240ca350 2024-08-17T02:27:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.800+0000 7f0829200640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:42.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.801+0000 7f0829200640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 0x7f0804067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0818007ba0 tx=0x7f0818008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.804+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f081004fa30 con 0x7f08240ca350 2024-08-17T02:27:42.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.989+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0824067dd0 con 0x7f08240ca350 2024-08-17T02:27:42.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.990+0000 7f0817e00640 1 -- 172.21.15.46:0/2190506860 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0810017070 con 0x7f08240ca350 2024-08-17T02:27:42.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:42.991 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 msgr2=0x7f0804067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 0x7f0804067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0818007ba0 tx=0x7f0818008040 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 msgr2=0x7f0824155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f081000c4c0 tx=0x7f0810007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 shutdown_connections 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08240ca720 0x7f08240afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08240ca350 0x7f0824155260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0804065150 0x7f0804067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 --2- 172.21.15.46:0/2190506860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08240ae1b0 0x7f08240c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.992+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 >> 172.21.15.46:0/2190506860 conn(0x7f08240cfdb0 msgr2=0x7f08240ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.993+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 shutdown_connections 2024-08-17T02:27:42.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:42.993+0000 7f082a600640 1 -- 172.21.15.46:0/2190506860 wait complete. 2024-08-17T02:27:43.008 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:43.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:43.074 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-08-17T02:27:43.074+0000 7fa0cec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.159+0000 7fd573600640 1 Processor -- start 2024-08-17T02:27:43.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.159+0000 7fd573600640 1 -- start start 2024-08-17T02:27:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.160+0000 7fd573600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd56c1401b0 0x7fd56c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.160+0000 7fd573600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 0x7fd56c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.160+0000 7fd573600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0b16d0 con 0x7fd56c0b1270 2024-08-17T02:27:43.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.160+0000 7fd573600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0cb450 con 0x7fd56c1401b0 2024-08-17T02:27:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.160+0000 7fd573600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0caa80 con 0x7fd56c140580 2024-08-17T02:27:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd571600640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd56c0b1270 0x7fd56c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38618/0 (socket says 172.21.15.46:38618) 2024-08-17T02:27:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd571600640 1 -- 172.21.15.46:0/2615384946 learned_addr learned my addr 172.21.15.46:0/2615384946 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:43.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd563e00640 1 --2- 172.21.15.46:0/2615384946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 0x7fd56c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd570c00640 1 --2- 172.21.15.46:0/2615384946 >> v2:172.21.15.162:3300/0 conn(0x7fd56c1401b0 0x7fd56c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd56be00640 1 -- 172.21.15.46:0/2615384946 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130397286 0 0) 0x7fd564001490 con 0x7fd56c0b1270 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd56be00640 1 -- 172.21.15.46:0/2615384946 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5500034e0 con 0x7fd56c0b1270 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd563e00640 1 -- 172.21.15.46:0/2615384946 >> v2:172.21.15.162:3300/0 conn(0x7fd56c1401b0 msgr2=0x7fd56c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd563e00640 1 --2- 172.21.15.46:0/2615384946 >> v2:172.21.15.162:3300/0 conn(0x7fd56c1401b0 0x7fd56c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd563e00640 1 -- 172.21.15.46:0/2615384946 >> v1:172.21.15.46:6789/0 conn(0x7fd56c0b1270 legacy=0x7fd56c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.161+0000 7fd563e00640 1 -- 172.21.15.46:0/2615384946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0c9e70 con 0x7fd56c140580 2024-08-17T02:27:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd563e00640 1 --2- 172.21.15.46:0/2615384946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 0x7fd56c0b0d30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd554009850 tx=0x7fd5540090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3d13a996b82a88 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd56be00640 1 -- 172.21.15.46:0/2615384946 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55402ad00 con 0x7fd56c140580 2024-08-17T02:27:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd56be00640 1 -- 172.21.15.46:0/2615384946 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55402ae60 con 0x7fd56c140580 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd56be00640 1 -- 172.21.15.46:0/2615384946 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd554032670 con 0x7fd56c140580 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd573600640 1 -- 172.21.15.46:0/2615384946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 msgr2=0x7fd56c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.163+0000 7fd573600640 1 --2- 172.21.15.46:0/2615384946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 0x7fd56c0b0d30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd554009850 tx=0x7fd5540090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 -- 172.21.15.46:0/2615384946 shutdown_connections 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 --2- 172.21.15.46:0/2615384946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c140580 0x7fd56c0b0d30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 --2- 172.21.15.46:0/2615384946 >> v2:172.21.15.162:3300/0 conn(0x7fd56c1401b0 0x7fd56c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 -- 172.21.15.46:0/2615384946 >> 172.21.15.46:0/2615384946 conn(0x7fd56c0cb9b0 msgr2=0x7fd56c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 -- 172.21.15.46:0/2615384946 shutdown_connections 2024-08-17T02:27:43.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.164+0000 7fd573600640 1 -- 172.21.15.46:0/2615384946 wait complete. 2024-08-17T02:27:43.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.165+0000 7fd573600640 1 Processor -- start 2024-08-17T02:27:43.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.165+0000 7fd573600640 1 -- start start 2024-08-17T02:27:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56c0b1270 0x7fd56c0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c1401b0 0x7fd56c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0aad40 con 0x7fd56c140580 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0aaf70 con 0x7fd56c0b1270 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd573600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0ab250 con 0x7fd56c1401b0 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd571600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd571600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40390/0 (socket says 172.21.15.46:40390) 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd571600640 1 -- 172.21.15.46:0/1067583548 learned_addr learned my addr 172.21.15.46:0/1067583548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd563e00640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c1401b0 0x7fd56c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.166+0000 7fd570c00640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56c0b1270 0x7fd56c0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 -- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c1401b0 msgr2=0x7fd56c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c1401b0 0x7fd56c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 -- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56c0b1270 msgr2=0x7fd56c0aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56c0b1270 0x7fd56c0aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 -- 172.21.15.46:0/1067583548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009390 con 0x7fd56c140580 2024-08-17T02:27:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd571600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cc40 tx=0x7fd564001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400ce00 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400a8e0 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400aca0 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c0ab530 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.167+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0abaf0 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.168+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c0abce0 con 0x7fd56c140580 2024-08-17T02:27:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.169+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd564007300 con 0x7fd56c140580 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.170+0000 7fd568c00640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 0x7fd548067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.170+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd564082430 con 0x7fd56c140580 2024-08-17T02:27:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.170+0000 7fd570c00640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 0x7fd548067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.171+0000 7fd570c00640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 0x7fd548067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009c80 tx=0x7fd55c0090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.174+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd564053f80 con 0x7fd56c140580 2024-08-17T02:27:43.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.352+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd56c0b16d0 con 0x7fd548065150 2024-08-17T02:27:43.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.361+0000 7fd568c00640 1 -- 172.21.15.46:0/1067583548 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264639 (secure 0 0 0) 0x7fd56c0b16d0 con 0x7fd548065150 2024-08-17T02:27:43.368 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:43.370 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:27:43.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.364+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 msgr2=0x7fd548067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.364+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 0x7fd548067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009c80 tx=0x7fd55c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.364+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 msgr2=0x7fd56c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.364+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56400cc40 tx=0x7fd564001a30 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 shutdown_connections 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd56c140580 0x7fd56c068bd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd548065150 0x7fd548067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd56c1401b0 0x7fd56c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 --2- 172.21.15.46:0/1067583548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56c0b1270 0x7fd56c0aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 >> 172.21.15.46:0/1067583548 conn(0x7fd56c0cb9b0 msgr2=0x7fd56c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 shutdown_connections 2024-08-17T02:27:43.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.365+0000 7fd573600640 1 -- 172.21.15.46:0/1067583548 wait complete. 2024-08-17T02:27:43.381 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:27:43.012294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398768,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575952,"statfs":{"total":773094113280,"available":770637774848,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.805850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962517+0000","last_change":"2024-08-17T02:27:38.958278+0000","last_active":"2024-08-17T02:27:38.962517+0000","last_peered":"2024-08-17T02:27:38.962517+0000","last_clean":"2024-08-17T02:27:38.962517+0000","last_became_active":"2024-08-17T02:27:38.957984+0000","last_became_peered":"2024-08-17T02:27:38.957984+0000","last_unstale":"2024-08-17T02:27:38.962517+0000","last_undegraded":"2024-08-17T02:27:38.962517+0000","last_fullsized":"2024-08-17T02:27:38.962517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.946817+0000","last_change":"2024-08-17T02:27:38.944267+0000","last_active":"2024-08-17T02:27:38.946817+0000","last_peered":"2024-08-17T02:27:38.946817+0000","last_clean":"2024-08-17T02:27:38.946817+0000","last_became_active":"2024-08-17T02:27:38.944006+0000","last_became_peered":"2024-08-17T02:27:38.944006+0000","last_unstale":"2024-08-17T02:27:38.946817+0000","last_undegraded":"2024-08-17T02:27:38.946817+0000","last_fullsized":"2024-08-17T02:27:38.946817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944649+0000","last_change":"2024-08-17T02:27:38.942978+0000","last_active":"2024-08-17T02:27:38.944649+0000","last_peered":"2024-08-17T02:27:38.944649+0000","last_clean":"2024-08-17T02:27:38.944649+0000","last_became_active":"2024-08-17T02:27:38.942718+0000","last_became_peered":"2024-08-17T02:27:38.942718+0000","last_unstale":"2024-08-17T02:27:38.944649+0000","last_undegraded":"2024-08-17T02:27:38.944649+0000","last_fullsized":"2024-08-17T02:27:38.944649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962421+0000","last_change":"2024-08-17T02:27:38.952449+0000","last_active":"2024-08-17T02:27:38.962421+0000","last_peered":"2024-08-17T02:27:38.962421+0000","last_clean":"2024-08-17T02:27:38.962421+0000","last_became_active":"2024-08-17T02:27:38.951835+0000","last_became_peered":"2024-08-17T02:27:38.951835+0000","last_unstale":"2024-08-17T02:27:38.962421+0000","last_undegraded":"2024-08-17T02:27:38.962421+0000","last_fullsized":"2024-08-17T02:27:38.962421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959709+0000","last_change":"2024-08-17T02:27:38.955373+0000","last_active":"2024-08-17T02:27:38.959709+0000","last_peered":"2024-08-17T02:27:38.959709+0000","last_clean":"2024-08-17T02:27:38.959709+0000","last_became_active":"2024-08-17T02:27:38.955029+0000","last_became_peered":"2024-08-17T02:27:38.955029+0000","last_unstale":"2024-08-17T02:27:38.959709+0000","last_undegraded":"2024-08-17T02:27:38.959709+0000","last_fullsized":"2024-08-17T02:27:38.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.947951+0000","last_change":"2024-08-17T02:27:38.942516+0000","last_active":"2024-08-17T02:27:38.947951+0000","last_peered":"2024-08-17T02:27:38.947951+0000","last_clean":"2024-08-17T02:27:38.947951+0000","last_became_active":"2024-08-17T02:27:38.942194+0000","last_became_peered":"2024-08-17T02:27:38.942194+0000","last_unstale":"2024-08-17T02:27:38.947951+0000","last_undegraded":"2024-08-17T02:27:38.947951+0000","last_fullsized":"2024-08-17T02:27:38.947951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960316+0000","last_change":"2024-08-17T02:27:38.946154+0000","last_active":"2024-08-17T02:27:38.960316+0000","last_peered":"2024-08-17T02:27:38.960316+0000","last_clean":"2024-08-17T02:27:38.960316+0000","last_became_active":"2024-08-17T02:27:38.945737+0000","last_became_peered":"2024-08-17T02:27:38.945737+0000","last_unstale":"2024-08-17T02:27:38.960316+0000","last_undegraded":"2024-08-17T02:27:38.960316+0000","last_fullsized":"2024-08-17T02:27:38.960316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.956360+0000","last_change":"2024-08-17T02:27:38.955006+0000","last_active":"2024-08-17T02:27:38.956360+0000","last_peered":"2024-08-17T02:27:38.956360+0000","last_clean":"2024-08-17T02:27:38.956360+0000","last_became_active":"2024-08-17T02:27:38.954720+0000","last_became_peered":"2024-08-17T02:27:38.954720+0000","last_unstale":"2024-08-17T02:27:38.956360+0000","last_undegraded":"2024-08-17T02:27:38.956360+0000","last_fullsized":"2024-08-17T02:27:38.956360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966232+0000","last_change":"2024-08-17T02:27:38.964613+0000","last_active":"2024-08-17T02:27:38.966232+0000","last_peered":"2024-08-17T02:27:38.966232+0000","last_clean":"2024-08-17T02:27:38.966232+0000","last_became_active":"2024-08-17T02:27:38.964331+0000","last_became_peered":"2024-08-17T02:27:38.964331+0000","last_unstale":"2024-08-17T02:27:38.966232+0000","last_undegraded":"2024-08-17T02:27:38.966232+0000","last_fullsized":"2024-08-17T02:27:38.966232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:44.158845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954749+0000","last_change":"2024-08-17T02:27:38.952858+0000","last_active":"2024-08-17T02:27:38.954749+0000","last_peered":"2024-08-17T02:27:38.954749+0000","last_clean":"2024-08-17T02:27:38.954749+0000","last_became_active":"2024-08-17T02:27:38.951695+0000","last_became_peered":"2024-08-17T02:27:38.951695+0000","last_unstale":"2024-08-17T02:27:38.954749+0000","last_undegraded":"2024-08-17T02:27:38.954749+0000","last_fullsized":"2024-08-17T02:27:38.954749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952093+0000","last_change":"2024-08-17T02:27:38.949326+0000","last_active":"2024-08-17T02:27:38.952093+0000","last_peered":"2024-08-17T02:27:38.952093+0000","last_clean":"2024-08-17T02:27:38.952093+0000","last_became_active":"2024-08-17T02:27:38.948495+0000","last_became_peered":"2024-08-17T02:27:38.948495+0000","last_unstale":"2024-08-17T02:27:38.952093+0000","last_undegraded":"2024-08-17T02:27:38.952093+0000","last_fullsized":"2024-08-17T02:27:38.952093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962468+0000","last_change":"2024-08-17T02:27:38.957539+0000","last_active":"2024-08-17T02:27:38.962468+0000","last_peered":"2024-08-17T02:27:38.962468+0000","last_clean":"2024-08-17T02:27:38.962468+0000","last_became_active":"2024-08-17T02:27:38.957141+0000","last_became_peered":"2024-08-17T02:27:38.957141+0000","last_unstale":"2024-08-17T02:27:38.962468+0000","last_undegraded":"2024-08-17T02:27:38.962468+0000","last_fullsized":"2024-08-17T02:27:38.962468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953273+0000","last_change":"2024-08-17T02:27:38.951276+0000","last_active":"2024-08-17T02:27:38.953273+0000","last_peered":"2024-08-17T02:27:38.953273+0000","last_clean":"2024-08-17T02:27:38.953273+0000","last_became_active":"2024-08-17T02:27:38.951019+0000","last_became_peered":"2024-08-17T02:27:38.951019+0000","last_unstale":"2024-08-17T02:27:38.953273+0000","last_undegraded":"2024-08-17T02:27:38.953273+0000","last_fullsized":"2024-08-17T02:27:38.953273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945764+0000","last_change":"2024-08-17T02:27:38.944212+0000","last_active":"2024-08-17T02:27:38.945764+0000","last_peered":"2024-08-17T02:27:38.945764+0000","last_clean":"2024-08-17T02:27:38.945764+0000","last_became_active":"2024-08-17T02:27:38.943893+0000","last_became_peered":"2024-08-17T02:27:38.943893+0000","last_unstale":"2024-08-17T02:27:38.945764+0000","last_undegraded":"2024-08-17T02:27:38.945764+0000","last_fullsized":"2024-08-17T02:27:38.945764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964237+0000","last_change":"2024-08-17T02:27:38.963326+0000","last_active":"2024-08-17T02:27:38.964237+0000","last_peered":"2024-08-17T02:27:38.964237+0000","last_clean":"2024-08-17T02:27:38.964237+0000","last_became_active":"2024-08-17T02:27:38.963045+0000","last_became_peered":"2024-08-17T02:27:38.963045+0000","last_unstale":"2024-08-17T02:27:38.964237+0000","last_undegraded":"2024-08-17T02:27:38.964237+0000","last_fullsized":"2024-08-17T02:27:38.964237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945157+0000","last_change":"2024-08-17T02:27:38.942730+0000","last_active":"2024-08-17T02:27:38.945157+0000","last_peered":"2024-08-17T02:27:38.945157+0000","last_clean":"2024-08-17T02:27:38.945157+0000","last_became_active":"2024-08-17T02:27:38.942318+0000","last_became_peered":"2024-08-17T02:27:38.942318+0000","last_unstale":"2024-08-17T02:27:38.945157+0000","last_undegraded":"2024-08-17T02:27:38.945157+0000","last_fullsized":"2024-08-17T02:27:38.945157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965284+0000","last_change":"2024-08-17T02:27:38.957401+0000","last_active":"2024-08-17T02:27:38.965284+0000","last_peered":"2024-08-17T02:27:38.965284+0000","last_clean":"2024-08-17T02:27:38.965284+0000","last_became_active":"2024-08-17T02:27:38.956806+0000","last_became_peered":"2024-08-17T02:27:38.956806+0000","last_unstale":"2024-08-17T02:27:38.965284+0000","last_undegraded":"2024-08-17T02:27:38.965284+0000","last_fullsized":"2024-08-17T02:27:38.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951390+0000","last_change":"2024-08-17T02:27:38.948303+0000","last_active":"2024-08-17T02:27:38.951390+0000","last_peered":"2024-08-17T02:27:38.951390+0000","last_clean":"2024-08-17T02:27:38.951390+0000","last_became_active":"2024-08-17T02:27:38.948045+0000","last_became_peered":"2024-08-17T02:27:38.948045+0000","last_unstale":"2024-08-17T02:27:38.951390+0000","last_undegraded":"2024-08-17T02:27:38.951390+0000","last_fullsized":"2024-08-17T02:27:38.951390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957615+0000","last_change":"2024-08-17T02:27:38.955302+0000","last_active":"2024-08-17T02:27:38.957615+0000","last_peered":"2024-08-17T02:27:38.957615+0000","last_clean":"2024-08-17T02:27:38.957615+0000","last_became_active":"2024-08-17T02:27:38.955011+0000","last_became_peered":"2024-08-17T02:27:38.955011+0000","last_unstale":"2024-08-17T02:27:38.957615+0000","last_undegraded":"2024-08-17T02:27:38.957615+0000","last_fullsized":"2024-08-17T02:27:38.957615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965503+0000","last_change":"2024-08-17T02:27:38.962208+0000","last_active":"2024-08-17T02:27:38.965503+0000","last_peered":"2024-08-17T02:27:38.965503+0000","last_clean":"2024-08-17T02:27:38.965503+0000","last_became_active":"2024-08-17T02:27:38.961860+0000","last_became_peered":"2024-08-17T02:27:38.961860+0000","last_unstale":"2024-08-17T02:27:38.965503+0000","last_undegraded":"2024-08-17T02:27:38.965503+0000","last_fullsized":"2024-08-17T02:27:38.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961179+0000","last_change":"2024-08-17T02:27:38.960549+0000","last_active":"2024-08-17T02:27:38.961179+0000","last_peered":"2024-08-17T02:27:38.961179+0000","last_clean":"2024-08-17T02:27:38.961179+0000","last_became_active":"2024-08-17T02:27:38.960365+0000","last_became_peered":"2024-08-17T02:27:38.960365+0000","last_unstale":"2024-08-17T02:27:38.961179+0000","last_undegraded":"2024-08-17T02:27:38.961179+0000","last_fullsized":"2024-08-17T02:27:38.961179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962883+0000","last_change":"2024-08-17T02:27:38.956102+0000","last_active":"2024-08-17T02:27:38.962883+0000","last_peered":"2024-08-17T02:27:38.962883+0000","last_clean":"2024-08-17T02:27:38.962883+0000","last_became_active":"2024-08-17T02:27:38.955662+0000","last_became_peered":"2024-08-17T02:27:38.955662+0000","last_unstale":"2024-08-17T02:27:38.962883+0000","last_undegraded":"2024-08-17T02:27:38.962883+0000","last_fullsized":"2024-08-17T02:27:38.962883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963896+0000","last_change":"2024-08-17T02:27:38.963135+0000","last_active":"2024-08-17T02:27:38.963896+0000","last_peered":"2024-08-17T02:27:38.963896+0000","last_clean":"2024-08-17T02:27:38.963896+0000","last_became_active":"2024-08-17T02:27:38.962870+0000","last_became_peered":"2024-08-17T02:27:38.962870+0000","last_unstale":"2024-08-17T02:27:38.963896+0000","last_undegraded":"2024-08-17T02:27:38.963896+0000","last_fullsized":"2024-08-17T02:27:38.963896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962232+0000","last_change":"2024-08-17T02:27:38.954011+0000","last_active":"2024-08-17T02:27:38.962232+0000","last_peered":"2024-08-17T02:27:38.962232+0000","last_clean":"2024-08-17T02:27:38.962232+0000","last_became_active":"2024-08-17T02:27:38.950742+0000","last_became_peered":"2024-08-17T02:27:38.950742+0000","last_unstale":"2024-08-17T02:27:38.962232+0000","last_undegraded":"2024-08-17T02:27:38.962232+0000","last_fullsized":"2024-08-17T02:27:38.962232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957913+0000","last_change":"2024-08-17T02:27:38.956849+0000","last_active":"2024-08-17T02:27:38.957913+0000","last_peered":"2024-08-17T02:27:38.957913+0000","last_clean":"2024-08-17T02:27:38.957913+0000","last_became_active":"2024-08-17T02:27:38.956343+0000","last_became_peered":"2024-08-17T02:27:38.956343+0000","last_unstale":"2024-08-17T02:27:38.957913+0000","last_undegraded":"2024-08-17T02:27:38.957913+0000","last_fullsized":"2024-08-17T02:27:38.957913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966173+0000","last_change":"2024-08-17T02:27:38.964205+0000","last_active":"2024-08-17T02:27:38.966173+0000","last_peered":"2024-08-17T02:27:38.966173+0000","last_clean":"2024-08-17T02:27:38.966173+0000","last_became_active":"2024-08-17T02:27:38.963917+0000","last_became_peered":"2024-08-17T02:27:38.963917+0000","last_unstale":"2024-08-17T02:27:38.966173+0000","last_undegraded":"2024-08-17T02:27:38.966173+0000","last_fullsized":"2024-08-17T02:27:38.966173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953689+0000","last_change":"2024-08-17T02:27:38.952501+0000","last_active":"2024-08-17T02:27:38.953689+0000","last_peered":"2024-08-17T02:27:38.953689+0000","last_clean":"2024-08-17T02:27:38.953689+0000","last_became_active":"2024-08-17T02:27:38.952172+0000","last_became_peered":"2024-08-17T02:27:38.952172+0000","last_unstale":"2024-08-17T02:27:38.953689+0000","last_undegraded":"2024-08-17T02:27:38.953689+0000","last_fullsized":"2024-08-17T02:27:38.953689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957901+0000","last_change":"2024-08-17T02:27:38.956673+0000","last_active":"2024-08-17T02:27:38.957901+0000","last_peered":"2024-08-17T02:27:38.957901+0000","last_clean":"2024-08-17T02:27:38.957901+0000","last_became_active":"2024-08-17T02:27:38.956396+0000","last_became_peered":"2024-08-17T02:27:38.956396+0000","last_unstale":"2024-08-17T02:27:38.957901+0000","last_undegraded":"2024-08-17T02:27:38.957901+0000","last_fullsized":"2024-08-17T02:27:38.957901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953576+0000","last_change":"2024-08-17T02:27:38.952052+0000","last_active":"2024-08-17T02:27:38.953576+0000","last_peered":"2024-08-17T02:27:38.953576+0000","last_clean":"2024-08-17T02:27:38.953576+0000","last_became_active":"2024-08-17T02:27:38.951782+0000","last_became_peered":"2024-08-17T02:27:38.951782+0000","last_unstale":"2024-08-17T02:27:38.953576+0000","last_undegraded":"2024-08-17T02:27:38.953576+0000","last_fullsized":"2024-08-17T02:27:38.953576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962863+0000","last_change":"2024-08-17T02:27:38.951396+0000","last_active":"2024-08-17T02:27:38.962863+0000","last_peered":"2024-08-17T02:27:38.962863+0000","last_clean":"2024-08-17T02:27:38.962863+0000","last_became_active":"2024-08-17T02:27:38.950821+0000","last_became_peered":"2024-08-17T02:27:38.950821+0000","last_unstale":"2024-08-17T02:27:38.962863+0000","last_undegraded":"2024-08-17T02:27:38.962863+0000","last_fullsized":"2024-08-17T02:27:38.962863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944409+0000","last_change":"2024-08-17T02:27:38.942963+0000","last_active":"2024-08-17T02:27:38.944409+0000","last_peered":"2024-08-17T02:27:38.944409+0000","last_clean":"2024-08-17T02:27:38.944409+0000","last_became_active":"2024-08-17T02:27:38.942517+0000","last_became_peered":"2024-08-17T02:27:38.942517+0000","last_unstale":"2024-08-17T02:27:38.944409+0000","last_undegraded":"2024-08-17T02:27:38.944409+0000","last_fullsized":"2024-08-17T02:27:38.944409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.948174+0000","last_change":"2024-08-17T02:27:38.945072+0000","last_active":"2024-08-17T02:27:38.948174+0000","last_peered":"2024-08-17T02:27:38.948174+0000","last_clean":"2024-08-17T02:27:38.948174+0000","last_became_active":"2024-08-17T02:27:38.944747+0000","last_became_peered":"2024-08-17T02:27:38.944747+0000","last_unstale":"2024-08-17T02:27:38.948174+0000","last_undegraded":"2024-08-17T02:27:38.948174+0000","last_fullsized":"2024-08-17T02:27:38.948174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960742+0000","last_change":"2024-08-17T02:27:38.954890+0000","last_active":"2024-08-17T02:27:38.960742+0000","last_peered":"2024-08-17T02:27:38.960742+0000","last_clean":"2024-08-17T02:27:38.960742+0000","last_became_active":"2024-08-17T02:27:38.954069+0000","last_became_peered":"2024-08-17T02:27:38.954069+0000","last_unstale":"2024-08-17T02:27:38.960742+0000","last_undegraded":"2024-08-17T02:27:38.960742+0000","last_fullsized":"2024-08-17T02:27:38.960742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220847+0000","last_change":"2024-08-17T02:27:38.231207+0000","last_active":"2024-08-17T02:27:39.220847+0000","last_peered":"2024-08-17T02:27:39.220847+0000","last_clean":"2024-08-17T02:27:39.220847+0000","last_became_active":"2024-08-17T02:27:38.230920+0000","last_became_peered":"2024-08-17T02:27:38.230920+0000","last_unstale":"2024-08-17T02:27:39.220847+0000","last_undegraded":"2024-08-17T02:27:39.220847+0000","last_fullsized":"2024-08-17T02:27:39.220847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959071+0000","last_change":"2024-08-17T02:27:38.958530+0000","last_active":"2024-08-17T02:27:38.959071+0000","last_peered":"2024-08-17T02:27:38.959071+0000","last_clean":"2024-08-17T02:27:38.959071+0000","last_became_active":"2024-08-17T02:27:38.958248+0000","last_became_peered":"2024-08-17T02:27:38.958248+0000","last_unstale":"2024-08-17T02:27:38.959071+0000","last_undegraded":"2024-08-17T02:27:38.959071+0000","last_fullsized":"2024-08-17T02:27:38.959071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:03.268893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220075+0000","last_change":"2024-08-17T02:27:38.230888+0000","last_active":"2024-08-17T02:27:39.220075+0000","last_peered":"2024-08-17T02:27:39.220075+0000","last_clean":"2024-08-17T02:27:39.220075+0000","last_became_active":"2024-08-17T02:27:38.230628+0000","last_became_peered":"2024-08-17T02:27:38.230628+0000","last_unstale":"2024-08-17T02:27:39.220075+0000","last_undegraded":"2024-08-17T02:27:39.220075+0000","last_fullsized":"2024-08-17T02:27:39.220075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945305+0000","last_change":"2024-08-17T02:27:38.232578+0000","last_active":"2024-08-17T02:27:38.945305+0000","last_peered":"2024-08-17T02:27:38.945305+0000","last_clean":"2024-08-17T02:27:38.945305+0000","last_became_active":"2024-08-17T02:27:38.232328+0000","last_became_peered":"2024-08-17T02:27:38.232328+0000","last_unstale":"2024-08-17T02:27:38.945305+0000","last_undegraded":"2024-08-17T02:27:38.945305+0000","last_fullsized":"2024-08-17T02:27:38.945305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952818+0000","last_change":"2024-08-17T02:27:38.949107+0000","last_active":"2024-08-17T02:27:38.952818+0000","last_peered":"2024-08-17T02:27:38.952818+0000","last_clean":"2024-08-17T02:27:38.952818+0000","last_became_active":"2024-08-17T02:27:38.948752+0000","last_became_peered":"2024-08-17T02:27:38.948752+0000","last_unstale":"2024-08-17T02:27:38.952818+0000","last_undegraded":"2024-08-17T02:27:38.952818+0000","last_fullsized":"2024-08-17T02:27:38.952818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935357+0000","last_change":"2024-08-17T02:27:38.231349+0000","last_active":"2024-08-17T02:27:38.935357+0000","last_peered":"2024-08-17T02:27:38.935357+0000","last_clean":"2024-08-17T02:27:38.935357+0000","last_became_active":"2024-08-17T02:27:38.229006+0000","last_became_peered":"2024-08-17T02:27:38.229006+0000","last_unstale":"2024-08-17T02:27:38.935357+0000","last_undegraded":"2024-08-17T02:27:38.935357+0000","last_fullsized":"2024-08-17T02:27:38.935357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950543+0000","last_change":"2024-08-17T02:27:38.947300+0000","last_active":"2024-08-17T02:27:38.950543+0000","last_peered":"2024-08-17T02:27:38.950543+0000","last_clean":"2024-08-17T02:27:38.950543+0000","last_became_active":"2024-08-17T02:27:38.947059+0000","last_became_peered":"2024-08-17T02:27:38.947059+0000","last_unstale":"2024-08-17T02:27:38.950543+0000","last_undegraded":"2024-08-17T02:27:38.950543+0000","last_fullsized":"2024-08-17T02:27:38.950543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940920+0000","last_change":"2024-08-17T02:27:38.232144+0000","last_active":"2024-08-17T02:27:38.940920+0000","last_peered":"2024-08-17T02:27:38.940920+0000","last_clean":"2024-08-17T02:27:38.940920+0000","last_became_active":"2024-08-17T02:27:38.231898+0000","last_became_peered":"2024-08-17T02:27:38.231898+0000","last_unstale":"2024-08-17T02:27:38.940920+0000","last_undegraded":"2024-08-17T02:27:38.940920+0000","last_fullsized":"2024-08-17T02:27:38.940920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963050+0000","last_change":"2024-08-17T02:27:38.956085+0000","last_active":"2024-08-17T02:27:38.963050+0000","last_peered":"2024-08-17T02:27:38.963050+0000","last_clean":"2024-08-17T02:27:38.963050+0000","last_became_active":"2024-08-17T02:27:38.955751+0000","last_became_peered":"2024-08-17T02:27:38.955751+0000","last_unstale":"2024-08-17T02:27:38.963050+0000","last_undegraded":"2024-08-17T02:27:38.963050+0000","last_fullsized":"2024-08-17T02:27:38.963050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936075+0000","last_change":"2024-08-17T02:27:38.232861+0000","last_active":"2024-08-17T02:27:38.936075+0000","last_peered":"2024-08-17T02:27:38.936075+0000","last_clean":"2024-08-17T02:27:38.936075+0000","last_became_active":"2024-08-17T02:27:38.232502+0000","last_became_peered":"2024-08-17T02:27:38.232502+0000","last_unstale":"2024-08-17T02:27:38.936075+0000","last_undegraded":"2024-08-17T02:27:38.936075+0000","last_fullsized":"2024-08-17T02:27:38.936075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953569+0000","last_change":"2024-08-17T02:27:38.951604+0000","last_active":"2024-08-17T02:27:38.953569+0000","last_peered":"2024-08-17T02:27:38.953569+0000","last_clean":"2024-08-17T02:27:38.953569+0000","last_became_active":"2024-08-17T02:27:38.950994+0000","last_became_peered":"2024-08-17T02:27:38.950994+0000","last_unstale":"2024-08-17T02:27:38.953569+0000","last_undegraded":"2024-08-17T02:27:38.953569+0000","last_fullsized":"2024-08-17T02:27:38.953569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:00.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222887+0000","last_change":"2024-08-17T02:27:38.236164+0000","last_active":"2024-08-17T02:27:39.222887+0000","last_peered":"2024-08-17T02:27:39.222887+0000","last_clean":"2024-08-17T02:27:39.222887+0000","last_became_active":"2024-08-17T02:27:38.235615+0000","last_became_peered":"2024-08-17T02:27:38.235615+0000","last_unstale":"2024-08-17T02:27:39.222887+0000","last_undegraded":"2024-08-17T02:27:39.222887+0000","last_fullsized":"2024-08-17T02:27:39.222887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965382+0000","last_change":"2024-08-17T02:27:38.962949+0000","last_active":"2024-08-17T02:27:38.965382+0000","last_peered":"2024-08-17T02:27:38.965382+0000","last_clean":"2024-08-17T02:27:38.965382+0000","last_became_active":"2024-08-17T02:27:38.960473+0000","last_became_peered":"2024-08-17T02:27:38.960473+0000","last_unstale":"2024-08-17T02:27:38.965382+0000","last_undegraded":"2024-08-17T02:27:38.965382+0000","last_fullsized":"2024-08-17T02:27:38.965382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:02.910612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.223251+0000","last_change":"2024-08-17T02:27:38.239544+0000","last_active":"2024-08-17T02:27:39.223251+0000","last_peered":"2024-08-17T02:27:39.223251+0000","last_clean":"2024-08-17T02:27:39.223251+0000","last_became_active":"2024-08-17T02:27:38.239105+0000","last_became_peered":"2024-08-17T02:27:38.239105+0000","last_unstale":"2024-08-17T02:27:39.223251+0000","last_undegraded":"2024-08-17T02:27:39.223251+0000","last_fullsized":"2024-08-17T02:27:39.223251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963452+0000","last_change":"2024-08-17T02:27:38.959403+0000","last_active":"2024-08-17T02:27:38.963452+0000","last_peered":"2024-08-17T02:27:38.963452+0000","last_clean":"2024-08-17T02:27:38.963452+0000","last_became_active":"2024-08-17T02:27:38.959187+0000","last_became_peered":"2024-08-17T02:27:38.959187+0000","last_unstale":"2024-08-17T02:27:38.963452+0000","last_undegraded":"2024-08-17T02:27:38.963452+0000","last_fullsized":"2024-08-17T02:27:38.963452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220958+0000","last_change":"2024-08-17T02:27:38.231982+0000","last_active":"2024-08-17T02:27:39.220958+0000","last_peered":"2024-08-17T02:27:39.220958+0000","last_clean":"2024-08-17T02:27:39.220958+0000","last_became_active":"2024-08-17T02:27:38.231721+0000","last_became_peered":"2024-08-17T02:27:38.231721+0000","last_unstale":"2024-08-17T02:27:39.220958+0000","last_undegraded":"2024-08-17T02:27:39.220958+0000","last_fullsized":"2024-08-17T02:27:39.220958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953724+0000","last_change":"2024-08-17T02:27:38.951652+0000","last_active":"2024-08-17T02:27:38.953724+0000","last_peered":"2024-08-17T02:27:38.953724+0000","last_clean":"2024-08-17T02:27:38.953724+0000","last_became_active":"2024-08-17T02:27:38.951389+0000","last_became_peered":"2024-08-17T02:27:38.951389+0000","last_unstale":"2024-08-17T02:27:38.953724+0000","last_undegraded":"2024-08-17T02:27:38.953724+0000","last_fullsized":"2024-08-17T02:27:38.953724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936958+0000","last_change":"2024-08-17T02:27:38.232932+0000","last_active":"2024-08-17T02:27:38.936958+0000","last_peered":"2024-08-17T02:27:38.936958+0000","last_clean":"2024-08-17T02:27:38.936958+0000","last_became_active":"2024-08-17T02:27:38.232660+0000","last_became_peered":"2024-08-17T02:27:38.232660+0000","last_unstale":"2024-08-17T02:27:38.936958+0000","last_undegraded":"2024-08-17T02:27:38.936958+0000","last_fullsized":"2024-08-17T02:27:38.936958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963894+0000","last_change":"2024-08-17T02:27:38.959826+0000","last_active":"2024-08-17T02:27:38.963894+0000","last_peered":"2024-08-17T02:27:38.963894+0000","last_clean":"2024-08-17T02:27:38.963894+0000","last_became_active":"2024-08-17T02:27:38.959504+0000","last_became_peered":"2024-08-17T02:27:38.959504+0000","last_unstale":"2024-08-17T02:27:38.963894+0000","last_undegraded":"2024-08-17T02:27:38.963894+0000","last_fullsized":"2024-08-17T02:27:38.963894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940921+0000","last_change":"2024-08-17T02:27:38.228984+0000","last_active":"2024-08-17T02:27:38.940921+0000","last_peered":"2024-08-17T02:27:38.940921+0000","last_clean":"2024-08-17T02:27:38.940921+0000","last_became_active":"2024-08-17T02:27:38.228654+0000","last_became_peered":"2024-08-17T02:27:38.228654+0000","last_unstale":"2024-08-17T02:27:38.940921+0000","last_undegraded":"2024-08-17T02:27:38.940921+0000","last_fullsized":"2024-08-17T02:27:38.940921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952020+0000","last_change":"2024-08-17T02:27:38.949332+0000","last_active":"2024-08-17T02:27:38.952020+0000","last_peered":"2024-08-17T02:27:38.952020+0000","last_clean":"2024-08-17T02:27:38.952020+0000","last_became_active":"2024-08-17T02:27:38.948725+0000","last_became_peered":"2024-08-17T02:27:38.948725+0000","last_unstale":"2024-08-17T02:27:38.952020+0000","last_undegraded":"2024-08-17T02:27:38.952020+0000","last_fullsized":"2024-08-17T02:27:38.952020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221358+0000","last_change":"2024-08-17T02:27:38.234103+0000","last_active":"2024-08-17T02:27:39.221358+0000","last_peered":"2024-08-17T02:27:39.221358+0000","last_clean":"2024-08-17T02:27:39.221358+0000","last_became_active":"2024-08-17T02:27:38.233720+0000","last_became_peered":"2024-08-17T02:27:38.233720+0000","last_unstale":"2024-08-17T02:27:39.221358+0000","last_undegraded":"2024-08-17T02:27:39.221358+0000","last_fullsized":"2024-08-17T02:27:39.221358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964797+0000","last_change":"2024-08-17T02:27:38.960907+0000","last_active":"2024-08-17T02:27:38.964797+0000","last_peered":"2024-08-17T02:27:38.964797+0000","last_clean":"2024-08-17T02:27:38.964797+0000","last_became_active":"2024-08-17T02:27:38.960512+0000","last_became_peered":"2024-08-17T02:27:38.960512+0000","last_unstale":"2024-08-17T02:27:38.964797+0000","last_undegraded":"2024-08-17T02:27:38.964797+0000","last_fullsized":"2024-08-17T02:27:38.964797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220665+0000","last_change":"2024-08-17T02:27:38.230338+0000","last_active":"2024-08-17T02:27:39.220665+0000","last_peered":"2024-08-17T02:27:39.220665+0000","last_clean":"2024-08-17T02:27:39.220665+0000","last_became_active":"2024-08-17T02:27:38.229932+0000","last_became_peered":"2024-08-17T02:27:38.229932+0000","last_unstale":"2024-08-17T02:27:39.220665+0000","last_undegraded":"2024-08-17T02:27:39.220665+0000","last_fullsized":"2024-08-17T02:27:39.220665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966062+0000","last_change":"2024-08-17T02:27:38.964572+0000","last_active":"2024-08-17T02:27:38.966062+0000","last_peered":"2024-08-17T02:27:38.966062+0000","last_clean":"2024-08-17T02:27:38.966062+0000","last_became_active":"2024-08-17T02:27:38.964171+0000","last_became_peered":"2024-08-17T02:27:38.964171+0000","last_unstale":"2024-08-17T02:27:38.966062+0000","last_undegraded":"2024-08-17T02:27:38.966062+0000","last_fullsized":"2024-08-17T02:27:38.966062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221364+0000","last_change":"2024-08-17T02:27:38.231746+0000","last_active":"2024-08-17T02:27:39.221364+0000","last_peered":"2024-08-17T02:27:39.221364+0000","last_clean":"2024-08-17T02:27:39.221364+0000","last_became_active":"2024-08-17T02:27:38.231403+0000","last_became_peered":"2024-08-17T02:27:38.231403+0000","last_unstale":"2024-08-17T02:27:39.221364+0000","last_undegraded":"2024-08-17T02:27:39.221364+0000","last_fullsized":"2024-08-17T02:27:39.221364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966830+0000","last_change":"2024-08-17T02:27:38.965438+0000","last_active":"2024-08-17T02:27:38.966830+0000","last_peered":"2024-08-17T02:27:38.966830+0000","last_clean":"2024-08-17T02:27:38.966830+0000","last_became_active":"2024-08-17T02:27:38.964623+0000","last_became_peered":"2024-08-17T02:27:38.964623+0000","last_unstale":"2024-08-17T02:27:38.966830+0000","last_undegraded":"2024-08-17T02:27:38.966830+0000","last_fullsized":"2024-08-17T02:27:38.966830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222595+0000","last_change":"2024-08-17T02:27:38.235902+0000","last_active":"2024-08-17T02:27:39.222595+0000","last_peered":"2024-08-17T02:27:39.222595+0000","last_clean":"2024-08-17T02:27:39.222595+0000","last_became_active":"2024-08-17T02:27:38.235584+0000","last_became_peered":"2024-08-17T02:27:38.235584+0000","last_unstale":"2024-08-17T02:27:39.222595+0000","last_undegraded":"2024-08-17T02:27:39.222595+0000","last_fullsized":"2024-08-17T02:27:39.222595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962432+0000","last_change":"2024-08-17T02:27:38.952664+0000","last_active":"2024-08-17T02:27:38.962432+0000","last_peered":"2024-08-17T02:27:38.962432+0000","last_clean":"2024-08-17T02:27:38.962432+0000","last_became_active":"2024-08-17T02:27:38.952205+0000","last_became_peered":"2024-08-17T02:27:38.952205+0000","last_unstale":"2024-08-17T02:27:38.962432+0000","last_undegraded":"2024-08-17T02:27:38.962432+0000","last_fullsized":"2024-08-17T02:27:38.962432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935719+0000","last_change":"2024-08-17T02:27:38.231965+0000","last_active":"2024-08-17T02:27:38.935719+0000","last_peered":"2024-08-17T02:27:38.935719+0000","last_clean":"2024-08-17T02:27:38.935719+0000","last_became_active":"2024-08-17T02:27:38.231608+0000","last_became_peered":"2024-08-17T02:27:38.231608+0000","last_unstale":"2024-08-17T02:27:38.935719+0000","last_undegraded":"2024-08-17T02:27:38.935719+0000","last_fullsized":"2024-08-17T02:27:38.935719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960138+0000","last_change":"2024-08-17T02:27:38.957545+0000","last_active":"2024-08-17T02:27:38.960138+0000","last_peered":"2024-08-17T02:27:38.960138+0000","last_clean":"2024-08-17T02:27:38.960138+0000","last_became_active":"2024-08-17T02:27:38.956306+0000","last_became_peered":"2024-08-17T02:27:38.956306+0000","last_unstale":"2024-08-17T02:27:38.960138+0000","last_undegraded":"2024-08-17T02:27:38.960138+0000","last_fullsized":"2024-08-17T02:27:38.960138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937438+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:27:38.937438+0000","last_peered":"2024-08-17T02:27:38.937438+0000","last_clean":"2024-08-17T02:27:38.937438+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:27:38.937438+0000","last_undegraded":"2024-08-17T02:27:38.937438+0000","last_fullsized":"2024-08-17T02:27:38.937438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935661+0000","last_change":"2024-08-17T02:27:38.221994+0000","last_active":"2024-08-17T02:27:38.935661+0000","last_peered":"2024-08-17T02:27:38.935661+0000","last_clean":"2024-08-17T02:27:38.935661+0000","last_became_active":"2024-08-17T02:27:38.221630+0000","last_became_peered":"2024-08-17T02:27:38.221630+0000","last_unstale":"2024-08-17T02:27:38.935661+0000","last_undegraded":"2024-08-17T02:27:38.935661+0000","last_fullsized":"2024-08-17T02:27:38.935661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952005+0000","last_change":"2024-08-17T02:27:38.948764+0000","last_active":"2024-08-17T02:27:38.952005+0000","last_peered":"2024-08-17T02:27:38.952005+0000","last_clean":"2024-08-17T02:27:38.952005+0000","last_became_active":"2024-08-17T02:27:38.948461+0000","last_became_peered":"2024-08-17T02:27:38.948461+0000","last_unstale":"2024-08-17T02:27:38.952005+0000","last_undegraded":"2024-08-17T02:27:38.952005+0000","last_fullsized":"2024-08-17T02:27:38.952005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937276+0000","last_change":"2024-08-17T02:27:38.227208+0000","last_active":"2024-08-17T02:27:38.937276+0000","last_peered":"2024-08-17T02:27:38.937276+0000","last_clean":"2024-08-17T02:27:38.937276+0000","last_became_active":"2024-08-17T02:27:38.226945+0000","last_became_peered":"2024-08-17T02:27:38.226945+0000","last_unstale":"2024-08-17T02:27:38.937276+0000","last_undegraded":"2024-08-17T02:27:38.937276+0000","last_fullsized":"2024-08-17T02:27:38.937276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961809+0000","last_change":"2024-08-17T02:27:38.961180+0000","last_active":"2024-08-17T02:27:38.961809+0000","last_peered":"2024-08-17T02:27:38.961809+0000","last_clean":"2024-08-17T02:27:38.961809+0000","last_became_active":"2024-08-17T02:27:38.960913+0000","last_became_peered":"2024-08-17T02:27:38.960913+0000","last_unstale":"2024-08-17T02:27:38.961809+0000","last_undegraded":"2024-08-17T02:27:38.961809+0000","last_fullsized":"2024-08-17T02:27:38.961809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.934691+0000","last_change":"2024-08-17T02:27:38.234380+0000","last_active":"2024-08-17T02:27:38.934691+0000","last_peered":"2024-08-17T02:27:38.934691+0000","last_clean":"2024-08-17T02:27:38.934691+0000","last_became_active":"2024-08-17T02:27:38.233537+0000","last_became_peered":"2024-08-17T02:27:38.233537+0000","last_unstale":"2024-08-17T02:27:38.934691+0000","last_undegraded":"2024-08-17T02:27:38.934691+0000","last_fullsized":"2024-08-17T02:27:38.934691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943563+0000","last_change":"2024-08-17T02:27:38.940399+0000","last_active":"2024-08-17T02:27:38.943563+0000","last_peered":"2024-08-17T02:27:38.943563+0000","last_clean":"2024-08-17T02:27:38.943563+0000","last_became_active":"2024-08-17T02:27:38.939407+0000","last_became_peered":"2024-08-17T02:27:38.939407+0000","last_unstale":"2024-08-17T02:27:38.943563+0000","last_undegraded":"2024-08-17T02:27:38.943563+0000","last_fullsized":"2024-08-17T02:27:38.943563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937108+0000","last_change":"2024-08-17T02:27:38.236139+0000","last_active":"2024-08-17T02:27:38.937108+0000","last_peered":"2024-08-17T02:27:38.937108+0000","last_clean":"2024-08-17T02:27:38.937108+0000","last_became_active":"2024-08-17T02:27:38.235906+0000","last_became_peered":"2024-08-17T02:27:38.235906+0000","last_unstale":"2024-08-17T02:27:38.937108+0000","last_undegraded":"2024-08-17T02:27:38.937108+0000","last_fullsized":"2024-08-17T02:27:38.937108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961622+0000","last_change":"2024-08-17T02:27:38.955645+0000","last_active":"2024-08-17T02:27:38.961622+0000","last_peered":"2024-08-17T02:27:38.961622+0000","last_clean":"2024-08-17T02:27:38.961622+0000","last_became_active":"2024-08-17T02:27:38.955312+0000","last_became_peered":"2024-08-17T02:27:38.955312+0000","last_unstale":"2024-08-17T02:27:38.961622+0000","last_undegraded":"2024-08-17T02:27:38.961622+0000","last_fullsized":"2024-08-17T02:27:38.961622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:47.735557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932702+0000","last_change":"2024-08-17T02:27:38.237877+0000","last_active":"2024-08-17T02:27:38.932702+0000","last_peered":"2024-08-17T02:27:38.932702+0000","last_clean":"2024-08-17T02:27:38.932702+0000","last_became_active":"2024-08-17T02:27:38.237636+0000","last_became_peered":"2024-08-17T02:27:38.237636+0000","last_unstale":"2024-08-17T02:27:38.932702+0000","last_undegraded":"2024-08-17T02:27:38.932702+0000","last_fullsized":"2024-08-17T02:27:38.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954404+0000","last_change":"2024-08-17T02:27:38.950989+0000","last_active":"2024-08-17T02:27:38.954404+0000","last_peered":"2024-08-17T02:27:38.954404+0000","last_clean":"2024-08-17T02:27:38.954404+0000","last_became_active":"2024-08-17T02:27:38.950684+0000","last_became_peered":"2024-08-17T02:27:38.950684+0000","last_unstale":"2024-08-17T02:27:38.954404+0000","last_undegraded":"2024-08-17T02:27:38.954404+0000","last_fullsized":"2024-08-17T02:27:38.954404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.938295+0000","last_change":"2024-08-17T02:27:38.229546+0000","last_active":"2024-08-17T02:27:38.938295+0000","last_peered":"2024-08-17T02:27:38.938295+0000","last_clean":"2024-08-17T02:27:38.938295+0000","last_became_active":"2024-08-17T02:27:38.229068+0000","last_became_peered":"2024-08-17T02:27:38.229068+0000","last_unstale":"2024-08-17T02:27:38.938295+0000","last_undegraded":"2024-08-17T02:27:38.938295+0000","last_fullsized":"2024-08-17T02:27:38.938295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943796+0000","last_change":"2024-08-17T02:27:38.940534+0000","last_active":"2024-08-17T02:27:38.943796+0000","last_peered":"2024-08-17T02:27:38.943796+0000","last_clean":"2024-08-17T02:27:38.943796+0000","last_became_active":"2024-08-17T02:27:38.940214+0000","last_became_peered":"2024-08-17T02:27:38.940214+0000","last_unstale":"2024-08-17T02:27:38.943796+0000","last_undegraded":"2024-08-17T02:27:38.943796+0000","last_fullsized":"2024-08-17T02:27:38.943796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933106+0000","last_change":"2024-08-17T02:27:38.232881+0000","last_active":"2024-08-17T02:27:38.933106+0000","last_peered":"2024-08-17T02:27:38.933106+0000","last_clean":"2024-08-17T02:27:38.933106+0000","last_became_active":"2024-08-17T02:27:38.232605+0000","last_became_peered":"2024-08-17T02:27:38.232605+0000","last_unstale":"2024-08-17T02:27:38.933106+0000","last_undegraded":"2024-08-17T02:27:38.933106+0000","last_fullsized":"2024-08-17T02:27:38.933106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965104+0000","last_change":"2024-08-17T02:27:38.964318+0000","last_active":"2024-08-17T02:27:38.965104+0000","last_peered":"2024-08-17T02:27:38.965104+0000","last_clean":"2024-08-17T02:27:38.965104+0000","last_became_active":"2024-08-17T02:27:38.964068+0000","last_became_peered":"2024-08-17T02:27:38.964068+0000","last_unstale":"2024-08-17T02:27:38.965104+0000","last_undegraded":"2024-08-17T02:27:38.965104+0000","last_fullsized":"2024-08-17T02:27:38.965104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220792+0000","last_change":"2024-08-17T02:27:38.233166+0000","last_active":"2024-08-17T02:27:39.220792+0000","last_peered":"2024-08-17T02:27:39.220792+0000","last_clean":"2024-08-17T02:27:39.220792+0000","last_became_active":"2024-08-17T02:27:38.232772+0000","last_became_peered":"2024-08-17T02:27:38.232772+0000","last_unstale":"2024-08-17T02:27:39.220792+0000","last_undegraded":"2024-08-17T02:27:39.220792+0000","last_fullsized":"2024-08-17T02:27:39.220792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950572+0000","last_change":"2024-08-17T02:27:38.947496+0000","last_active":"2024-08-17T02:27:38.950572+0000","last_peered":"2024-08-17T02:27:38.950572+0000","last_clean":"2024-08-17T02:27:38.950572+0000","last_became_active":"2024-08-17T02:27:38.945946+0000","last_became_peered":"2024-08-17T02:27:38.945946+0000","last_unstale":"2024-08-17T02:27:38.950572+0000","last_undegraded":"2024-08-17T02:27:38.950572+0000","last_fullsized":"2024-08-17T02:27:38.950572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937161+0000","last_change":"2024-08-17T02:27:38.225331+0000","last_active":"2024-08-17T02:27:38.937161+0000","last_peered":"2024-08-17T02:27:38.937161+0000","last_clean":"2024-08-17T02:27:38.937161+0000","last_became_active":"2024-08-17T02:27:38.222853+0000","last_became_peered":"2024-08-17T02:27:38.222853+0000","last_unstale":"2024-08-17T02:27:38.937161+0000","last_undegraded":"2024-08-17T02:27:38.937161+0000","last_fullsized":"2024-08-17T02:27:38.937161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962392+0000","last_change":"2024-08-17T02:27:38.957489+0000","last_active":"2024-08-17T02:27:38.962392+0000","last_peered":"2024-08-17T02:27:38.962392+0000","last_clean":"2024-08-17T02:27:38.962392+0000","last_became_active":"2024-08-17T02:27:38.957214+0000","last_became_peered":"2024-08-17T02:27:38.957214+0000","last_unstale":"2024-08-17T02:27:38.962392+0000","last_undegraded":"2024-08-17T02:27:38.962392+0000","last_fullsized":"2024-08-17T02:27:38.962392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:19.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932946+0000","last_change":"2024-08-17T02:27:38.234553+0000","last_active":"2024-08-17T02:27:38.932946+0000","last_peered":"2024-08-17T02:27:38.932946+0000","last_clean":"2024-08-17T02:27:38.932946+0000","last_became_active":"2024-08-17T02:27:38.234040+0000","last_became_peered":"2024-08-17T02:27:38.234040+0000","last_unstale":"2024-08-17T02:27:38.932946+0000","last_undegraded":"2024-08-17T02:27:38.932946+0000","last_fullsized":"2024-08-17T02:27:38.932946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950101+0000","last_change":"2024-08-17T02:27:38.946873+0000","last_active":"2024-08-17T02:27:38.950101+0000","last_peered":"2024-08-17T02:27:38.950101+0000","last_clean":"2024-08-17T02:27:38.950101+0000","last_became_active":"2024-08-17T02:27:38.946553+0000","last_became_peered":"2024-08-17T02:27:38.946553+0000","last_unstale":"2024-08-17T02:27:38.950101+0000","last_undegraded":"2024-08-17T02:27:38.950101+0000","last_fullsized":"2024-08-17T02:27:38.950101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933576+0000","last_change":"2024-08-17T02:27:38.235261+0000","last_active":"2024-08-17T02:27:38.933576+0000","last_peered":"2024-08-17T02:27:38.933576+0000","last_clean":"2024-08-17T02:27:38.933576+0000","last_became_active":"2024-08-17T02:27:38.234975+0000","last_became_peered":"2024-08-17T02:27:38.234975+0000","last_unstale":"2024-08-17T02:27:38.933576+0000","last_undegraded":"2024-08-17T02:27:38.933576+0000","last_fullsized":"2024-08-17T02:27:38.933576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951870+0000","last_change":"2024-08-17T02:27:38.948237+0000","last_active":"2024-08-17T02:27:38.951870+0000","last_peered":"2024-08-17T02:27:38.951870+0000","last_clean":"2024-08-17T02:27:38.951870+0000","last_became_active":"2024-08-17T02:27:38.947980+0000","last_became_peered":"2024-08-17T02:27:38.947980+0000","last_unstale":"2024-08-17T02:27:38.951870+0000","last_undegraded":"2024-08-17T02:27:38.951870+0000","last_fullsized":"2024-08-17T02:27:38.951870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220208+0000","last_change":"2024-08-17T02:27:38.224385+0000","last_active":"2024-08-17T02:27:39.220208+0000","last_peered":"2024-08-17T02:27:39.220208+0000","last_clean":"2024-08-17T02:27:39.220208+0000","last_became_active":"2024-08-17T02:27:38.224112+0000","last_became_peered":"2024-08-17T02:27:38.224112+0000","last_unstale":"2024-08-17T02:27:39.220208+0000","last_undegraded":"2024-08-17T02:27:39.220208+0000","last_fullsized":"2024-08-17T02:27:39.220208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960003+0000","last_change":"2024-08-17T02:27:38.958582+0000","last_active":"2024-08-17T02:27:38.960003+0000","last_peered":"2024-08-17T02:27:38.960003+0000","last_clean":"2024-08-17T02:27:38.960003+0000","last_became_active":"2024-08-17T02:27:38.958297+0000","last_became_peered":"2024-08-17T02:27:38.958297+0000","last_unstale":"2024-08-17T02:27:38.960003+0000","last_undegraded":"2024-08-17T02:27:38.960003+0000","last_fullsized":"2024-08-17T02:27:38.960003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965620+0000","last_change":"2024-08-17T02:27:38.958334+0000","last_active":"2024-08-17T02:27:38.965620+0000","last_peered":"2024-08-17T02:27:38.965620+0000","last_clean":"2024-08-17T02:27:38.965620+0000","last_became_active":"2024-08-17T02:27:38.958023+0000","last_became_peered":"2024-08-17T02:27:38.958023+0000","last_unstale":"2024-08-17T02:27:38.965620+0000","last_undegraded":"2024-08-17T02:27:38.965620+0000","last_fullsized":"2024-08-17T02:27:38.965620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221510+0000","last_change":"2024-08-17T02:27:38.227961+0000","last_active":"2024-08-17T02:27:39.221510+0000","last_peered":"2024-08-17T02:27:39.221510+0000","last_clean":"2024-08-17T02:27:39.221510+0000","last_became_active":"2024-08-17T02:27:38.227515+0000","last_became_peered":"2024-08-17T02:27:38.227515+0000","last_unstale":"2024-08-17T02:27:39.221510+0000","last_undegraded":"2024-08-17T02:27:39.221510+0000","last_fullsized":"2024-08-17T02:27:39.221510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962441+0000","last_change":"2024-08-17T02:27:38.956122+0000","last_active":"2024-08-17T02:27:38.962441+0000","last_peered":"2024-08-17T02:27:38.962441+0000","last_clean":"2024-08-17T02:27:38.962441+0000","last_became_active":"2024-08-17T02:27:38.955849+0000","last_became_peered":"2024-08-17T02:27:38.955849+0000","last_unstale":"2024-08-17T02:27:38.962441+0000","last_undegraded":"2024-08-17T02:27:38.962441+0000","last_fullsized":"2024-08-17T02:27:38.962441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220743+0000","last_change":"2024-08-17T02:27:38.229758+0000","last_active":"2024-08-17T02:27:39.220743+0000","last_peered":"2024-08-17T02:27:39.220743+0000","last_clean":"2024-08-17T02:27:39.220743+0000","last_became_active":"2024-08-17T02:27:38.229308+0000","last_became_peered":"2024-08-17T02:27:38.229308+0000","last_unstale":"2024-08-17T02:27:39.220743+0000","last_undegraded":"2024-08-17T02:27:39.220743+0000","last_fullsized":"2024-08-17T02:27:39.220743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953549+0000","last_change":"2024-08-17T02:27:38.951247+0000","last_active":"2024-08-17T02:27:38.953549+0000","last_peered":"2024-08-17T02:27:38.953549+0000","last_clean":"2024-08-17T02:27:38.953549+0000","last_became_active":"2024-08-17T02:27:38.950979+0000","last_became_peered":"2024-08-17T02:27:38.950979+0000","last_unstale":"2024-08-17T02:27:38.953549+0000","last_undegraded":"2024-08-17T02:27:38.953549+0000","last_fullsized":"2024-08-17T02:27:38.953549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:13.804400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220328+0000","last_change":"2024-08-17T02:27:38.231845+0000","last_active":"2024-08-17T02:27:39.220328+0000","last_peered":"2024-08-17T02:27:39.220328+0000","last_clean":"2024-08-17T02:27:39.220328+0000","last_became_active":"2024-08-17T02:27:38.231535+0000","last_became_peered":"2024-08-17T02:27:38.231535+0000","last_unstale":"2024-08-17T02:27:39.220328+0000","last_undegraded":"2024-08-17T02:27:39.220328+0000","last_fullsized":"2024-08-17T02:27:39.220328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953028+0000","last_change":"2024-08-17T02:27:38.950278+0000","last_active":"2024-08-17T02:27:38.953028+0000","last_peered":"2024-08-17T02:27:38.953028+0000","last_clean":"2024-08-17T02:27:38.953028+0000","last_became_active":"2024-08-17T02:27:38.949470+0000","last_became_peered":"2024-08-17T02:27:38.949470+0000","last_unstale":"2024-08-17T02:27:38.953028+0000","last_undegraded":"2024-08-17T02:27:38.953028+0000","last_fullsized":"2024-08-17T02:27:38.953028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222977+0000","last_change":"2024-08-17T02:27:38.227009+0000","last_active":"2024-08-17T02:27:39.222977+0000","last_peered":"2024-08-17T02:27:39.222977+0000","last_clean":"2024-08-17T02:27:39.222977+0000","last_became_active":"2024-08-17T02:27:38.226613+0000","last_became_peered":"2024-08-17T02:27:38.226613+0000","last_unstale":"2024-08-17T02:27:39.222977+0000","last_undegraded":"2024-08-17T02:27:39.222977+0000","last_fullsized":"2024-08-17T02:27:39.222977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:36.242448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:43.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:43.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:43.486 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:43.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.572+0000 7fc814000640 1 Processor -- start 2024-08-17T02:27:43.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.572+0000 7fc814000640 1 -- start start 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc814000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc80c0cc430 0x7fc80c0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc814000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c0ca700 con 0x7fc80c067ef0 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc814000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c0684f0 con 0x7fc80c062da0 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc814000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0682e0 con 0x7fc80c0cc430 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc811600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc80c0cc430 0x7fc80c0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc811600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc80c0cc430 0x7fc80c0cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40396/0 (socket says 172.21.15.46:40396) 2024-08-17T02:27:43.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.573+0000 7fc811600640 1 -- 172.21.15.46:0/1983193734 learned_addr learned my addr 172.21.15.46:0/1983193734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:43.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.574+0000 7fc811600640 1 -- 172.21.15.46:0/1983193734 >> v1:172.21.15.162:6789/0 conn(0x7fc80c062da0 legacy=0x7fc80c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.574+0000 7fc811600640 1 -- 172.21.15.46:0/1983193734 >> v1:172.21.15.46:6789/0 conn(0x7fc80c067ef0 legacy=0x7fc80c0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.574+0000 7fc811600640 1 -- 172.21.15.46:0/1983193734 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c0c9dd0 con 0x7fc80c0cc430 2024-08-17T02:27:43.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.574+0000 7fc80be00640 1 -- 172.21.15.46:0/1983193734 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765809356 0 0) 0x7fc80c0ca700 con 0x7fc80c067ef0 2024-08-17T02:27:43.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.575+0000 7fc811600640 1 --2- 172.21.15.46:0/1983193734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c0cc430 0x7fc80c0cc800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc800009910 tx=0x7fc8000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875a9016f7ebc208 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.575+0000 7fc80be00640 1 -- 172.21.15.46:0/1983193734 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800032440 con 0x7fc80c0cc430 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.575+0000 7fc80be00640 1 -- 172.21.15.46:0/1983193734 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8000325a0 con 0x7fc80c0cc430 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.575+0000 7fc80be00640 1 -- 172.21.15.46:0/1983193734 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800032940 con 0x7fc80c0cc430 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 -- 172.21.15.46:0/1983193734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c0cc430 msgr2=0x7fc80c0cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 --2- 172.21.15.46:0/1983193734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c0cc430 0x7fc80c0cc800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc800009910 tx=0x7fc8000091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 -- 172.21.15.46:0/1983193734 shutdown_connections 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 --2- 172.21.15.46:0/1983193734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c0cc430 0x7fc80c0cc800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 -- 172.21.15.46:0/1983193734 >> 172.21.15.46:0/1983193734 conn(0x7fc80c0afc30 msgr2=0x7fc80c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 -- 172.21.15.46:0/1983193734 shutdown_connections 2024-08-17T02:27:43.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.576+0000 7fc814000640 1 -- 172.21.15.46:0/1983193734 wait complete. 2024-08-17T02:27:43.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.577+0000 7fc814000640 1 Processor -- start 2024-08-17T02:27:43.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.577+0000 7fc814000640 1 -- start start 2024-08-17T02:27:43.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 0x7fc80c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 0x7fc80c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c169e60 con 0x7fc80c067ef0 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c16cf90 con 0x7fc80c0cc430 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.578+0000 7fc814000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c16c660 con 0x7fc80c062da0 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40412/0 (socket says 172.21.15.46:40412) 2024-08-17T02:27:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 -- 172.21.15.46:0/187743880 learned_addr learned my addr 172.21.15.46:0/187743880 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc811600640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 0x7fc80c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 -- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 msgr2=0x7fc80c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc812000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 0x7fc80c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 0x7fc80c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 -- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 msgr2=0x7fc80c069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 0x7fc80c069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 -- 172.21.15.46:0/187743880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009450 con 0x7fc80c067ef0 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc811600640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 0x7fc80c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc812000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 0x7fc80c069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.579+0000 7fc810c00640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c4f0 tx=0x7fc7f8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.580+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011590 con 0x7fc80c067ef0 2024-08-17T02:27:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.580+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8011710 con 0x7fc80c067ef0 2024-08-17T02:27:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.580+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c16c940 con 0x7fc80c067ef0 2024-08-17T02:27:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.580+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011ad0 con 0x7fc80c067ef0 2024-08-17T02:27:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.580+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c14f4d0 con 0x7fc80c067ef0 2024-08-17T02:27:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.581+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c064db0 con 0x7fc80c067ef0 2024-08-17T02:27:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.582+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc7f801b3b0 con 0x7fc80c067ef0 2024-08-17T02:27:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.583+0000 7fc808c00640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 0x7fc7ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.583+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7f8081920 con 0x7fc80c067ef0 2024-08-17T02:27:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.583+0000 7fc811600640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 0x7fc7ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.584+0000 7fc811600640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 0x7fc7ec067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc800034000 tx=0x7fc800032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.586+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc7f804f940 con 0x7fc80c067ef0 2024-08-17T02:27:43.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.772+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc80c16d0d0 con 0x7fc7ec065150 2024-08-17T02:27:43.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.781+0000 7fc808c00640 1 -- 172.21.15.46:0/187743880 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264639 (secure 0 0 0) 0x7fc80c16d0d0 con 0x7fc7ec065150 2024-08-17T02:27:43.784 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:43.786 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:27:43.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.784+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 msgr2=0x7fc7ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.784+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 0x7fc7ec067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc800034000 tx=0x7fc800032000 comp rx=0 tx=0).stop 2024-08-17T02:27:43.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.784+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 msgr2=0x7fc80c0693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.784+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800c4f0 tx=0x7fc7f8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 shutdown_connections 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc80c0cc430 0x7fc80c069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc80c067ef0 0x7fc80c0693f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc7ec065150 0x7fc7ec067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 --2- 172.21.15.46:0/187743880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc80c062da0 0x7fc80c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 >> 172.21.15.46:0/187743880 conn(0x7fc80c0afc30 msgr2=0x7fc80c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 shutdown_connections 2024-08-17T02:27:43.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.785+0000 7fc814000640 1 -- 172.21.15.46:0/187743880 wait complete. 2024-08-17T02:27:43.800 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-08-17T02:27:43.012294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398768,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575952,"statfs":{"total":773094113280,"available":770637774848,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.805850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962517+0000","last_change":"2024-08-17T02:27:38.958278+0000","last_active":"2024-08-17T02:27:38.962517+0000","last_peered":"2024-08-17T02:27:38.962517+0000","last_clean":"2024-08-17T02:27:38.962517+0000","last_became_active":"2024-08-17T02:27:38.957984+0000","last_became_peered":"2024-08-17T02:27:38.957984+0000","last_unstale":"2024-08-17T02:27:38.962517+0000","last_undegraded":"2024-08-17T02:27:38.962517+0000","last_fullsized":"2024-08-17T02:27:38.962517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.946817+0000","last_change":"2024-08-17T02:27:38.944267+0000","last_active":"2024-08-17T02:27:38.946817+0000","last_peered":"2024-08-17T02:27:38.946817+0000","last_clean":"2024-08-17T02:27:38.946817+0000","last_became_active":"2024-08-17T02:27:38.944006+0000","last_became_peered":"2024-08-17T02:27:38.944006+0000","last_unstale":"2024-08-17T02:27:38.946817+0000","last_undegraded":"2024-08-17T02:27:38.946817+0000","last_fullsized":"2024-08-17T02:27:38.946817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944649+0000","last_change":"2024-08-17T02:27:38.942978+0000","last_active":"2024-08-17T02:27:38.944649+0000","last_peered":"2024-08-17T02:27:38.944649+0000","last_clean":"2024-08-17T02:27:38.944649+0000","last_became_active":"2024-08-17T02:27:38.942718+0000","last_became_peered":"2024-08-17T02:27:38.942718+0000","last_unstale":"2024-08-17T02:27:38.944649+0000","last_undegraded":"2024-08-17T02:27:38.944649+0000","last_fullsized":"2024-08-17T02:27:38.944649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962421+0000","last_change":"2024-08-17T02:27:38.952449+0000","last_active":"2024-08-17T02:27:38.962421+0000","last_peered":"2024-08-17T02:27:38.962421+0000","last_clean":"2024-08-17T02:27:38.962421+0000","last_became_active":"2024-08-17T02:27:38.951835+0000","last_became_peered":"2024-08-17T02:27:38.951835+0000","last_unstale":"2024-08-17T02:27:38.962421+0000","last_undegraded":"2024-08-17T02:27:38.962421+0000","last_fullsized":"2024-08-17T02:27:38.962421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959709+0000","last_change":"2024-08-17T02:27:38.955373+0000","last_active":"2024-08-17T02:27:38.959709+0000","last_peered":"2024-08-17T02:27:38.959709+0000","last_clean":"2024-08-17T02:27:38.959709+0000","last_became_active":"2024-08-17T02:27:38.955029+0000","last_became_peered":"2024-08-17T02:27:38.955029+0000","last_unstale":"2024-08-17T02:27:38.959709+0000","last_undegraded":"2024-08-17T02:27:38.959709+0000","last_fullsized":"2024-08-17T02:27:38.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.947951+0000","last_change":"2024-08-17T02:27:38.942516+0000","last_active":"2024-08-17T02:27:38.947951+0000","last_peered":"2024-08-17T02:27:38.947951+0000","last_clean":"2024-08-17T02:27:38.947951+0000","last_became_active":"2024-08-17T02:27:38.942194+0000","last_became_peered":"2024-08-17T02:27:38.942194+0000","last_unstale":"2024-08-17T02:27:38.947951+0000","last_undegraded":"2024-08-17T02:27:38.947951+0000","last_fullsized":"2024-08-17T02:27:38.947951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960316+0000","last_change":"2024-08-17T02:27:38.946154+0000","last_active":"2024-08-17T02:27:38.960316+0000","last_peered":"2024-08-17T02:27:38.960316+0000","last_clean":"2024-08-17T02:27:38.960316+0000","last_became_active":"2024-08-17T02:27:38.945737+0000","last_became_peered":"2024-08-17T02:27:38.945737+0000","last_unstale":"2024-08-17T02:27:38.960316+0000","last_undegraded":"2024-08-17T02:27:38.960316+0000","last_fullsized":"2024-08-17T02:27:38.960316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.956360+0000","last_change":"2024-08-17T02:27:38.955006+0000","last_active":"2024-08-17T02:27:38.956360+0000","last_peered":"2024-08-17T02:27:38.956360+0000","last_clean":"2024-08-17T02:27:38.956360+0000","last_became_active":"2024-08-17T02:27:38.954720+0000","last_became_peered":"2024-08-17T02:27:38.954720+0000","last_unstale":"2024-08-17T02:27:38.956360+0000","last_undegraded":"2024-08-17T02:27:38.956360+0000","last_fullsized":"2024-08-17T02:27:38.956360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966232+0000","last_change":"2024-08-17T02:27:38.964613+0000","last_active":"2024-08-17T02:27:38.966232+0000","last_peered":"2024-08-17T02:27:38.966232+0000","last_clean":"2024-08-17T02:27:38.966232+0000","last_became_active":"2024-08-17T02:27:38.964331+0000","last_became_peered":"2024-08-17T02:27:38.964331+0000","last_unstale":"2024-08-17T02:27:38.966232+0000","last_undegraded":"2024-08-17T02:27:38.966232+0000","last_fullsized":"2024-08-17T02:27:38.966232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:44.158845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954749+0000","last_change":"2024-08-17T02:27:38.952858+0000","last_active":"2024-08-17T02:27:38.954749+0000","last_peered":"2024-08-17T02:27:38.954749+0000","last_clean":"2024-08-17T02:27:38.954749+0000","last_became_active":"2024-08-17T02:27:38.951695+0000","last_became_peered":"2024-08-17T02:27:38.951695+0000","last_unstale":"2024-08-17T02:27:38.954749+0000","last_undegraded":"2024-08-17T02:27:38.954749+0000","last_fullsized":"2024-08-17T02:27:38.954749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952093+0000","last_change":"2024-08-17T02:27:38.949326+0000","last_active":"2024-08-17T02:27:38.952093+0000","last_peered":"2024-08-17T02:27:38.952093+0000","last_clean":"2024-08-17T02:27:38.952093+0000","last_became_active":"2024-08-17T02:27:38.948495+0000","last_became_peered":"2024-08-17T02:27:38.948495+0000","last_unstale":"2024-08-17T02:27:38.952093+0000","last_undegraded":"2024-08-17T02:27:38.952093+0000","last_fullsized":"2024-08-17T02:27:38.952093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962468+0000","last_change":"2024-08-17T02:27:38.957539+0000","last_active":"2024-08-17T02:27:38.962468+0000","last_peered":"2024-08-17T02:27:38.962468+0000","last_clean":"2024-08-17T02:27:38.962468+0000","last_became_active":"2024-08-17T02:27:38.957141+0000","last_became_peered":"2024-08-17T02:27:38.957141+0000","last_unstale":"2024-08-17T02:27:38.962468+0000","last_undegraded":"2024-08-17T02:27:38.962468+0000","last_fullsized":"2024-08-17T02:27:38.962468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953273+0000","last_change":"2024-08-17T02:27:38.951276+0000","last_active":"2024-08-17T02:27:38.953273+0000","last_peered":"2024-08-17T02:27:38.953273+0000","last_clean":"2024-08-17T02:27:38.953273+0000","last_became_active":"2024-08-17T02:27:38.951019+0000","last_became_peered":"2024-08-17T02:27:38.951019+0000","last_unstale":"2024-08-17T02:27:38.953273+0000","last_undegraded":"2024-08-17T02:27:38.953273+0000","last_fullsized":"2024-08-17T02:27:38.953273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945764+0000","last_change":"2024-08-17T02:27:38.944212+0000","last_active":"2024-08-17T02:27:38.945764+0000","last_peered":"2024-08-17T02:27:38.945764+0000","last_clean":"2024-08-17T02:27:38.945764+0000","last_became_active":"2024-08-17T02:27:38.943893+0000","last_became_peered":"2024-08-17T02:27:38.943893+0000","last_unstale":"2024-08-17T02:27:38.945764+0000","last_undegraded":"2024-08-17T02:27:38.945764+0000","last_fullsized":"2024-08-17T02:27:38.945764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964237+0000","last_change":"2024-08-17T02:27:38.963326+0000","last_active":"2024-08-17T02:27:38.964237+0000","last_peered":"2024-08-17T02:27:38.964237+0000","last_clean":"2024-08-17T02:27:38.964237+0000","last_became_active":"2024-08-17T02:27:38.963045+0000","last_became_peered":"2024-08-17T02:27:38.963045+0000","last_unstale":"2024-08-17T02:27:38.964237+0000","last_undegraded":"2024-08-17T02:27:38.964237+0000","last_fullsized":"2024-08-17T02:27:38.964237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945157+0000","last_change":"2024-08-17T02:27:38.942730+0000","last_active":"2024-08-17T02:27:38.945157+0000","last_peered":"2024-08-17T02:27:38.945157+0000","last_clean":"2024-08-17T02:27:38.945157+0000","last_became_active":"2024-08-17T02:27:38.942318+0000","last_became_peered":"2024-08-17T02:27:38.942318+0000","last_unstale":"2024-08-17T02:27:38.945157+0000","last_undegraded":"2024-08-17T02:27:38.945157+0000","last_fullsized":"2024-08-17T02:27:38.945157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965284+0000","last_change":"2024-08-17T02:27:38.957401+0000","last_active":"2024-08-17T02:27:38.965284+0000","last_peered":"2024-08-17T02:27:38.965284+0000","last_clean":"2024-08-17T02:27:38.965284+0000","last_became_active":"2024-08-17T02:27:38.956806+0000","last_became_peered":"2024-08-17T02:27:38.956806+0000","last_unstale":"2024-08-17T02:27:38.965284+0000","last_undegraded":"2024-08-17T02:27:38.965284+0000","last_fullsized":"2024-08-17T02:27:38.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951390+0000","last_change":"2024-08-17T02:27:38.948303+0000","last_active":"2024-08-17T02:27:38.951390+0000","last_peered":"2024-08-17T02:27:38.951390+0000","last_clean":"2024-08-17T02:27:38.951390+0000","last_became_active":"2024-08-17T02:27:38.948045+0000","last_became_peered":"2024-08-17T02:27:38.948045+0000","last_unstale":"2024-08-17T02:27:38.951390+0000","last_undegraded":"2024-08-17T02:27:38.951390+0000","last_fullsized":"2024-08-17T02:27:38.951390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957615+0000","last_change":"2024-08-17T02:27:38.955302+0000","last_active":"2024-08-17T02:27:38.957615+0000","last_peered":"2024-08-17T02:27:38.957615+0000","last_clean":"2024-08-17T02:27:38.957615+0000","last_became_active":"2024-08-17T02:27:38.955011+0000","last_became_peered":"2024-08-17T02:27:38.955011+0000","last_unstale":"2024-08-17T02:27:38.957615+0000","last_undegraded":"2024-08-17T02:27:38.957615+0000","last_fullsized":"2024-08-17T02:27:38.957615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965503+0000","last_change":"2024-08-17T02:27:38.962208+0000","last_active":"2024-08-17T02:27:38.965503+0000","last_peered":"2024-08-17T02:27:38.965503+0000","last_clean":"2024-08-17T02:27:38.965503+0000","last_became_active":"2024-08-17T02:27:38.961860+0000","last_became_peered":"2024-08-17T02:27:38.961860+0000","last_unstale":"2024-08-17T02:27:38.965503+0000","last_undegraded":"2024-08-17T02:27:38.965503+0000","last_fullsized":"2024-08-17T02:27:38.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961179+0000","last_change":"2024-08-17T02:27:38.960549+0000","last_active":"2024-08-17T02:27:38.961179+0000","last_peered":"2024-08-17T02:27:38.961179+0000","last_clean":"2024-08-17T02:27:38.961179+0000","last_became_active":"2024-08-17T02:27:38.960365+0000","last_became_peered":"2024-08-17T02:27:38.960365+0000","last_unstale":"2024-08-17T02:27:38.961179+0000","last_undegraded":"2024-08-17T02:27:38.961179+0000","last_fullsized":"2024-08-17T02:27:38.961179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962883+0000","last_change":"2024-08-17T02:27:38.956102+0000","last_active":"2024-08-17T02:27:38.962883+0000","last_peered":"2024-08-17T02:27:38.962883+0000","last_clean":"2024-08-17T02:27:38.962883+0000","last_became_active":"2024-08-17T02:27:38.955662+0000","last_became_peered":"2024-08-17T02:27:38.955662+0000","last_unstale":"2024-08-17T02:27:38.962883+0000","last_undegraded":"2024-08-17T02:27:38.962883+0000","last_fullsized":"2024-08-17T02:27:38.962883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963896+0000","last_change":"2024-08-17T02:27:38.963135+0000","last_active":"2024-08-17T02:27:38.963896+0000","last_peered":"2024-08-17T02:27:38.963896+0000","last_clean":"2024-08-17T02:27:38.963896+0000","last_became_active":"2024-08-17T02:27:38.962870+0000","last_became_peered":"2024-08-17T02:27:38.962870+0000","last_unstale":"2024-08-17T02:27:38.963896+0000","last_undegraded":"2024-08-17T02:27:38.963896+0000","last_fullsized":"2024-08-17T02:27:38.963896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962232+0000","last_change":"2024-08-17T02:27:38.954011+0000","last_active":"2024-08-17T02:27:38.962232+0000","last_peered":"2024-08-17T02:27:38.962232+0000","last_clean":"2024-08-17T02:27:38.962232+0000","last_became_active":"2024-08-17T02:27:38.950742+0000","last_became_peered":"2024-08-17T02:27:38.950742+0000","last_unstale":"2024-08-17T02:27:38.962232+0000","last_undegraded":"2024-08-17T02:27:38.962232+0000","last_fullsized":"2024-08-17T02:27:38.962232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957913+0000","last_change":"2024-08-17T02:27:38.956849+0000","last_active":"2024-08-17T02:27:38.957913+0000","last_peered":"2024-08-17T02:27:38.957913+0000","last_clean":"2024-08-17T02:27:38.957913+0000","last_became_active":"2024-08-17T02:27:38.956343+0000","last_became_peered":"2024-08-17T02:27:38.956343+0000","last_unstale":"2024-08-17T02:27:38.957913+0000","last_undegraded":"2024-08-17T02:27:38.957913+0000","last_fullsized":"2024-08-17T02:27:38.957913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966173+0000","last_change":"2024-08-17T02:27:38.964205+0000","last_active":"2024-08-17T02:27:38.966173+0000","last_peered":"2024-08-17T02:27:38.966173+0000","last_clean":"2024-08-17T02:27:38.966173+0000","last_became_active":"2024-08-17T02:27:38.963917+0000","last_became_peered":"2024-08-17T02:27:38.963917+0000","last_unstale":"2024-08-17T02:27:38.966173+0000","last_undegraded":"2024-08-17T02:27:38.966173+0000","last_fullsized":"2024-08-17T02:27:38.966173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953689+0000","last_change":"2024-08-17T02:27:38.952501+0000","last_active":"2024-08-17T02:27:38.953689+0000","last_peered":"2024-08-17T02:27:38.953689+0000","last_clean":"2024-08-17T02:27:38.953689+0000","last_became_active":"2024-08-17T02:27:38.952172+0000","last_became_peered":"2024-08-17T02:27:38.952172+0000","last_unstale":"2024-08-17T02:27:38.953689+0000","last_undegraded":"2024-08-17T02:27:38.953689+0000","last_fullsized":"2024-08-17T02:27:38.953689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957901+0000","last_change":"2024-08-17T02:27:38.956673+0000","last_active":"2024-08-17T02:27:38.957901+0000","last_peered":"2024-08-17T02:27:38.957901+0000","last_clean":"2024-08-17T02:27:38.957901+0000","last_became_active":"2024-08-17T02:27:38.956396+0000","last_became_peered":"2024-08-17T02:27:38.956396+0000","last_unstale":"2024-08-17T02:27:38.957901+0000","last_undegraded":"2024-08-17T02:27:38.957901+0000","last_fullsized":"2024-08-17T02:27:38.957901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953576+0000","last_change":"2024-08-17T02:27:38.952052+0000","last_active":"2024-08-17T02:27:38.953576+0000","last_peered":"2024-08-17T02:27:38.953576+0000","last_clean":"2024-08-17T02:27:38.953576+0000","last_became_active":"2024-08-17T02:27:38.951782+0000","last_became_peered":"2024-08-17T02:27:38.951782+0000","last_unstale":"2024-08-17T02:27:38.953576+0000","last_undegraded":"2024-08-17T02:27:38.953576+0000","last_fullsized":"2024-08-17T02:27:38.953576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962863+0000","last_change":"2024-08-17T02:27:38.951396+0000","last_active":"2024-08-17T02:27:38.962863+0000","last_peered":"2024-08-17T02:27:38.962863+0000","last_clean":"2024-08-17T02:27:38.962863+0000","last_became_active":"2024-08-17T02:27:38.950821+0000","last_became_peered":"2024-08-17T02:27:38.950821+0000","last_unstale":"2024-08-17T02:27:38.962863+0000","last_undegraded":"2024-08-17T02:27:38.962863+0000","last_fullsized":"2024-08-17T02:27:38.962863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944409+0000","last_change":"2024-08-17T02:27:38.942963+0000","last_active":"2024-08-17T02:27:38.944409+0000","last_peered":"2024-08-17T02:27:38.944409+0000","last_clean":"2024-08-17T02:27:38.944409+0000","last_became_active":"2024-08-17T02:27:38.942517+0000","last_became_peered":"2024-08-17T02:27:38.942517+0000","last_unstale":"2024-08-17T02:27:38.944409+0000","last_undegraded":"2024-08-17T02:27:38.944409+0000","last_fullsized":"2024-08-17T02:27:38.944409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.948174+0000","last_change":"2024-08-17T02:27:38.945072+0000","last_active":"2024-08-17T02:27:38.948174+0000","last_peered":"2024-08-17T02:27:38.948174+0000","last_clean":"2024-08-17T02:27:38.948174+0000","last_became_active":"2024-08-17T02:27:38.944747+0000","last_became_peered":"2024-08-17T02:27:38.944747+0000","last_unstale":"2024-08-17T02:27:38.948174+0000","last_undegraded":"2024-08-17T02:27:38.948174+0000","last_fullsized":"2024-08-17T02:27:38.948174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960742+0000","last_change":"2024-08-17T02:27:38.954890+0000","last_active":"2024-08-17T02:27:38.960742+0000","last_peered":"2024-08-17T02:27:38.960742+0000","last_clean":"2024-08-17T02:27:38.960742+0000","last_became_active":"2024-08-17T02:27:38.954069+0000","last_became_peered":"2024-08-17T02:27:38.954069+0000","last_unstale":"2024-08-17T02:27:38.960742+0000","last_undegraded":"2024-08-17T02:27:38.960742+0000","last_fullsized":"2024-08-17T02:27:38.960742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220847+0000","last_change":"2024-08-17T02:27:38.231207+0000","last_active":"2024-08-17T02:27:39.220847+0000","last_peered":"2024-08-17T02:27:39.220847+0000","last_clean":"2024-08-17T02:27:39.220847+0000","last_became_active":"2024-08-17T02:27:38.230920+0000","last_became_peered":"2024-08-17T02:27:38.230920+0000","last_unstale":"2024-08-17T02:27:39.220847+0000","last_undegraded":"2024-08-17T02:27:39.220847+0000","last_fullsized":"2024-08-17T02:27:39.220847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959071+0000","last_change":"2024-08-17T02:27:38.958530+0000","last_active":"2024-08-17T02:27:38.959071+0000","last_peered":"2024-08-17T02:27:38.959071+0000","last_clean":"2024-08-17T02:27:38.959071+0000","last_became_active":"2024-08-17T02:27:38.958248+0000","last_became_peered":"2024-08-17T02:27:38.958248+0000","last_unstale":"2024-08-17T02:27:38.959071+0000","last_undegraded":"2024-08-17T02:27:38.959071+0000","last_fullsized":"2024-08-17T02:27:38.959071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:03.268893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220075+0000","last_change":"2024-08-17T02:27:38.230888+0000","last_active":"2024-08-17T02:27:39.220075+0000","last_peered":"2024-08-17T02:27:39.220075+0000","last_clean":"2024-08-17T02:27:39.220075+0000","last_became_active":"2024-08-17T02:27:38.230628+0000","last_became_peered":"2024-08-17T02:27:38.230628+0000","last_unstale":"2024-08-17T02:27:39.220075+0000","last_undegraded":"2024-08-17T02:27:39.220075+0000","last_fullsized":"2024-08-17T02:27:39.220075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945305+0000","last_change":"2024-08-17T02:27:38.232578+0000","last_active":"2024-08-17T02:27:38.945305+0000","last_peered":"2024-08-17T02:27:38.945305+0000","last_clean":"2024-08-17T02:27:38.945305+0000","last_became_active":"2024-08-17T02:27:38.232328+0000","last_became_peered":"2024-08-17T02:27:38.232328+0000","last_unstale":"2024-08-17T02:27:38.945305+0000","last_undegraded":"2024-08-17T02:27:38.945305+0000","last_fullsized":"2024-08-17T02:27:38.945305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952818+0000","last_change":"2024-08-17T02:27:38.949107+0000","last_active":"2024-08-17T02:27:38.952818+0000","last_peered":"2024-08-17T02:27:38.952818+0000","last_clean":"2024-08-17T02:27:38.952818+0000","last_became_active":"2024-08-17T02:27:38.948752+0000","last_became_peered":"2024-08-17T02:27:38.948752+0000","last_unstale":"2024-08-17T02:27:38.952818+0000","last_undegraded":"2024-08-17T02:27:38.952818+0000","last_fullsized":"2024-08-17T02:27:38.952818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935357+0000","last_change":"2024-08-17T02:27:38.231349+0000","last_active":"2024-08-17T02:27:38.935357+0000","last_peered":"2024-08-17T02:27:38.935357+0000","last_clean":"2024-08-17T02:27:38.935357+0000","last_became_active":"2024-08-17T02:27:38.229006+0000","last_became_peered":"2024-08-17T02:27:38.229006+0000","last_unstale":"2024-08-17T02:27:38.935357+0000","last_undegraded":"2024-08-17T02:27:38.935357+0000","last_fullsized":"2024-08-17T02:27:38.935357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950543+0000","last_change":"2024-08-17T02:27:38.947300+0000","last_active":"2024-08-17T02:27:38.950543+0000","last_peered":"2024-08-17T02:27:38.950543+0000","last_clean":"2024-08-17T02:27:38.950543+0000","last_became_active":"2024-08-17T02:27:38.947059+0000","last_became_peered":"2024-08-17T02:27:38.947059+0000","last_unstale":"2024-08-17T02:27:38.950543+0000","last_undegraded":"2024-08-17T02:27:38.950543+0000","last_fullsized":"2024-08-17T02:27:38.950543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940920+0000","last_change":"2024-08-17T02:27:38.232144+0000","last_active":"2024-08-17T02:27:38.940920+0000","last_peered":"2024-08-17T02:27:38.940920+0000","last_clean":"2024-08-17T02:27:38.940920+0000","last_became_active":"2024-08-17T02:27:38.231898+0000","last_became_peered":"2024-08-17T02:27:38.231898+0000","last_unstale":"2024-08-17T02:27:38.940920+0000","last_undegraded":"2024-08-17T02:27:38.940920+0000","last_fullsized":"2024-08-17T02:27:38.940920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963050+0000","last_change":"2024-08-17T02:27:38.956085+0000","last_active":"2024-08-17T02:27:38.963050+0000","last_peered":"2024-08-17T02:27:38.963050+0000","last_clean":"2024-08-17T02:27:38.963050+0000","last_became_active":"2024-08-17T02:27:38.955751+0000","last_became_peered":"2024-08-17T02:27:38.955751+0000","last_unstale":"2024-08-17T02:27:38.963050+0000","last_undegraded":"2024-08-17T02:27:38.963050+0000","last_fullsized":"2024-08-17T02:27:38.963050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936075+0000","last_change":"2024-08-17T02:27:38.232861+0000","last_active":"2024-08-17T02:27:38.936075+0000","last_peered":"2024-08-17T02:27:38.936075+0000","last_clean":"2024-08-17T02:27:38.936075+0000","last_became_active":"2024-08-17T02:27:38.232502+0000","last_became_peered":"2024-08-17T02:27:38.232502+0000","last_unstale":"2024-08-17T02:27:38.936075+0000","last_undegraded":"2024-08-17T02:27:38.936075+0000","last_fullsized":"2024-08-17T02:27:38.936075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953569+0000","last_change":"2024-08-17T02:27:38.951604+0000","last_active":"2024-08-17T02:27:38.953569+0000","last_peered":"2024-08-17T02:27:38.953569+0000","last_clean":"2024-08-17T02:27:38.953569+0000","last_became_active":"2024-08-17T02:27:38.950994+0000","last_became_peered":"2024-08-17T02:27:38.950994+0000","last_unstale":"2024-08-17T02:27:38.953569+0000","last_undegraded":"2024-08-17T02:27:38.953569+0000","last_fullsized":"2024-08-17T02:27:38.953569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:00.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222887+0000","last_change":"2024-08-17T02:27:38.236164+0000","last_active":"2024-08-17T02:27:39.222887+0000","last_peered":"2024-08-17T02:27:39.222887+0000","last_clean":"2024-08-17T02:27:39.222887+0000","last_became_active":"2024-08-17T02:27:38.235615+0000","last_became_peered":"2024-08-17T02:27:38.235615+0000","last_unstale":"2024-08-17T02:27:39.222887+0000","last_undegraded":"2024-08-17T02:27:39.222887+0000","last_fullsized":"2024-08-17T02:27:39.222887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965382+0000","last_change":"2024-08-17T02:27:38.962949+0000","last_active":"2024-08-17T02:27:38.965382+0000","last_peered":"2024-08-17T02:27:38.965382+0000","last_clean":"2024-08-17T02:27:38.965382+0000","last_became_active":"2024-08-17T02:27:38.960473+0000","last_became_peered":"2024-08-17T02:27:38.960473+0000","last_unstale":"2024-08-17T02:27:38.965382+0000","last_undegraded":"2024-08-17T02:27:38.965382+0000","last_fullsized":"2024-08-17T02:27:38.965382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:02.910612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.223251+0000","last_change":"2024-08-17T02:27:38.239544+0000","last_active":"2024-08-17T02:27:39.223251+0000","last_peered":"2024-08-17T02:27:39.223251+0000","last_clean":"2024-08-17T02:27:39.223251+0000","last_became_active":"2024-08-17T02:27:38.239105+0000","last_became_peered":"2024-08-17T02:27:38.239105+0000","last_unstale":"2024-08-17T02:27:39.223251+0000","last_undegraded":"2024-08-17T02:27:39.223251+0000","last_fullsized":"2024-08-17T02:27:39.223251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963452+0000","last_change":"2024-08-17T02:27:38.959403+0000","last_active":"2024-08-17T02:27:38.963452+0000","last_peered":"2024-08-17T02:27:38.963452+0000","last_clean":"2024-08-17T02:27:38.963452+0000","last_became_active":"2024-08-17T02:27:38.959187+0000","last_became_peered":"2024-08-17T02:27:38.959187+0000","last_unstale":"2024-08-17T02:27:38.963452+0000","last_undegraded":"2024-08-17T02:27:38.963452+0000","last_fullsized":"2024-08-17T02:27:38.963452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220958+0000","last_change":"2024-08-17T02:27:38.231982+0000","last_active":"2024-08-17T02:27:39.220958+0000","last_peered":"2024-08-17T02:27:39.220958+0000","last_clean":"2024-08-17T02:27:39.220958+0000","last_became_active":"2024-08-17T02:27:38.231721+0000","last_became_peered":"2024-08-17T02:27:38.231721+0000","last_unstale":"2024-08-17T02:27:39.220958+0000","last_undegraded":"2024-08-17T02:27:39.220958+0000","last_fullsized":"2024-08-17T02:27:39.220958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953724+0000","last_change":"2024-08-17T02:27:38.951652+0000","last_active":"2024-08-17T02:27:38.953724+0000","last_peered":"2024-08-17T02:27:38.953724+0000","last_clean":"2024-08-17T02:27:38.953724+0000","last_became_active":"2024-08-17T02:27:38.951389+0000","last_became_peered":"2024-08-17T02:27:38.951389+0000","last_unstale":"2024-08-17T02:27:38.953724+0000","last_undegraded":"2024-08-17T02:27:38.953724+0000","last_fullsized":"2024-08-17T02:27:38.953724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936958+0000","last_change":"2024-08-17T02:27:38.232932+0000","last_active":"2024-08-17T02:27:38.936958+0000","last_peered":"2024-08-17T02:27:38.936958+0000","last_clean":"2024-08-17T02:27:38.936958+0000","last_became_active":"2024-08-17T02:27:38.232660+0000","last_became_peered":"2024-08-17T02:27:38.232660+0000","last_unstale":"2024-08-17T02:27:38.936958+0000","last_undegraded":"2024-08-17T02:27:38.936958+0000","last_fullsized":"2024-08-17T02:27:38.936958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963894+0000","last_change":"2024-08-17T02:27:38.959826+0000","last_active":"2024-08-17T02:27:38.963894+0000","last_peered":"2024-08-17T02:27:38.963894+0000","last_clean":"2024-08-17T02:27:38.963894+0000","last_became_active":"2024-08-17T02:27:38.959504+0000","last_became_peered":"2024-08-17T02:27:38.959504+0000","last_unstale":"2024-08-17T02:27:38.963894+0000","last_undegraded":"2024-08-17T02:27:38.963894+0000","last_fullsized":"2024-08-17T02:27:38.963894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940921+0000","last_change":"2024-08-17T02:27:38.228984+0000","last_active":"2024-08-17T02:27:38.940921+0000","last_peered":"2024-08-17T02:27:38.940921+0000","last_clean":"2024-08-17T02:27:38.940921+0000","last_became_active":"2024-08-17T02:27:38.228654+0000","last_became_peered":"2024-08-17T02:27:38.228654+0000","last_unstale":"2024-08-17T02:27:38.940921+0000","last_undegraded":"2024-08-17T02:27:38.940921+0000","last_fullsized":"2024-08-17T02:27:38.940921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952020+0000","last_change":"2024-08-17T02:27:38.949332+0000","last_active":"2024-08-17T02:27:38.952020+0000","last_peered":"2024-08-17T02:27:38.952020+0000","last_clean":"2024-08-17T02:27:38.952020+0000","last_became_active":"2024-08-17T02:27:38.948725+0000","last_became_peered":"2024-08-17T02:27:38.948725+0000","last_unstale":"2024-08-17T02:27:38.952020+0000","last_undegraded":"2024-08-17T02:27:38.952020+0000","last_fullsized":"2024-08-17T02:27:38.952020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221358+0000","last_change":"2024-08-17T02:27:38.234103+0000","last_active":"2024-08-17T02:27:39.221358+0000","last_peered":"2024-08-17T02:27:39.221358+0000","last_clean":"2024-08-17T02:27:39.221358+0000","last_became_active":"2024-08-17T02:27:38.233720+0000","last_became_peered":"2024-08-17T02:27:38.233720+0000","last_unstale":"2024-08-17T02:27:39.221358+0000","last_undegraded":"2024-08-17T02:27:39.221358+0000","last_fullsized":"2024-08-17T02:27:39.221358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964797+0000","last_change":"2024-08-17T02:27:38.960907+0000","last_active":"2024-08-17T02:27:38.964797+0000","last_peered":"2024-08-17T02:27:38.964797+0000","last_clean":"2024-08-17T02:27:38.964797+0000","last_became_active":"2024-08-17T02:27:38.960512+0000","last_became_peered":"2024-08-17T02:27:38.960512+0000","last_unstale":"2024-08-17T02:27:38.964797+0000","last_undegraded":"2024-08-17T02:27:38.964797+0000","last_fullsized":"2024-08-17T02:27:38.964797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220665+0000","last_change":"2024-08-17T02:27:38.230338+0000","last_active":"2024-08-17T02:27:39.220665+0000","last_peered":"2024-08-17T02:27:39.220665+0000","last_clean":"2024-08-17T02:27:39.220665+0000","last_became_active":"2024-08-17T02:27:38.229932+0000","last_became_peered":"2024-08-17T02:27:38.229932+0000","last_unstale":"2024-08-17T02:27:39.220665+0000","last_undegraded":"2024-08-17T02:27:39.220665+0000","last_fullsized":"2024-08-17T02:27:39.220665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966062+0000","last_change":"2024-08-17T02:27:38.964572+0000","last_active":"2024-08-17T02:27:38.966062+0000","last_peered":"2024-08-17T02:27:38.966062+0000","last_clean":"2024-08-17T02:27:38.966062+0000","last_became_active":"2024-08-17T02:27:38.964171+0000","last_became_peered":"2024-08-17T02:27:38.964171+0000","last_unstale":"2024-08-17T02:27:38.966062+0000","last_undegraded":"2024-08-17T02:27:38.966062+0000","last_fullsized":"2024-08-17T02:27:38.966062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221364+0000","last_change":"2024-08-17T02:27:38.231746+0000","last_active":"2024-08-17T02:27:39.221364+0000","last_peered":"2024-08-17T02:27:39.221364+0000","last_clean":"2024-08-17T02:27:39.221364+0000","last_became_active":"2024-08-17T02:27:38.231403+0000","last_became_peered":"2024-08-17T02:27:38.231403+0000","last_unstale":"2024-08-17T02:27:39.221364+0000","last_undegraded":"2024-08-17T02:27:39.221364+0000","last_fullsized":"2024-08-17T02:27:39.221364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966830+0000","last_change":"2024-08-17T02:27:38.965438+0000","last_active":"2024-08-17T02:27:38.966830+0000","last_peered":"2024-08-17T02:27:38.966830+0000","last_clean":"2024-08-17T02:27:38.966830+0000","last_became_active":"2024-08-17T02:27:38.964623+0000","last_became_peered":"2024-08-17T02:27:38.964623+0000","last_unstale":"2024-08-17T02:27:38.966830+0000","last_undegraded":"2024-08-17T02:27:38.966830+0000","last_fullsized":"2024-08-17T02:27:38.966830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222595+0000","last_change":"2024-08-17T02:27:38.235902+0000","last_active":"2024-08-17T02:27:39.222595+0000","last_peered":"2024-08-17T02:27:39.222595+0000","last_clean":"2024-08-17T02:27:39.222595+0000","last_became_active":"2024-08-17T02:27:38.235584+0000","last_became_peered":"2024-08-17T02:27:38.235584+0000","last_unstale":"2024-08-17T02:27:39.222595+0000","last_undegraded":"2024-08-17T02:27:39.222595+0000","last_fullsized":"2024-08-17T02:27:39.222595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962432+0000","last_change":"2024-08-17T02:27:38.952664+0000","last_active":"2024-08-17T02:27:38.962432+0000","last_peered":"2024-08-17T02:27:38.962432+0000","last_clean":"2024-08-17T02:27:38.962432+0000","last_became_active":"2024-08-17T02:27:38.952205+0000","last_became_peered":"2024-08-17T02:27:38.952205+0000","last_unstale":"2024-08-17T02:27:38.962432+0000","last_undegraded":"2024-08-17T02:27:38.962432+0000","last_fullsized":"2024-08-17T02:27:38.962432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935719+0000","last_change":"2024-08-17T02:27:38.231965+0000","last_active":"2024-08-17T02:27:38.935719+0000","last_peered":"2024-08-17T02:27:38.935719+0000","last_clean":"2024-08-17T02:27:38.935719+0000","last_became_active":"2024-08-17T02:27:38.231608+0000","last_became_peered":"2024-08-17T02:27:38.231608+0000","last_unstale":"2024-08-17T02:27:38.935719+0000","last_undegraded":"2024-08-17T02:27:38.935719+0000","last_fullsized":"2024-08-17T02:27:38.935719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960138+0000","last_change":"2024-08-17T02:27:38.957545+0000","last_active":"2024-08-17T02:27:38.960138+0000","last_peered":"2024-08-17T02:27:38.960138+0000","last_clean":"2024-08-17T02:27:38.960138+0000","last_became_active":"2024-08-17T02:27:38.956306+0000","last_became_peered":"2024-08-17T02:27:38.956306+0000","last_unstale":"2024-08-17T02:27:38.960138+0000","last_undegraded":"2024-08-17T02:27:38.960138+0000","last_fullsized":"2024-08-17T02:27:38.960138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937438+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:27:38.937438+0000","last_peered":"2024-08-17T02:27:38.937438+0000","last_clean":"2024-08-17T02:27:38.937438+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:27:38.937438+0000","last_undegraded":"2024-08-17T02:27:38.937438+0000","last_fullsized":"2024-08-17T02:27:38.937438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935661+0000","last_change":"2024-08-17T02:27:38.221994+0000","last_active":"2024-08-17T02:27:38.935661+0000","last_peered":"2024-08-17T02:27:38.935661+0000","last_clean":"2024-08-17T02:27:38.935661+0000","last_became_active":"2024-08-17T02:27:38.221630+0000","last_became_peered":"2024-08-17T02:27:38.221630+0000","last_unstale":"2024-08-17T02:27:38.935661+0000","last_undegraded":"2024-08-17T02:27:38.935661+0000","last_fullsized":"2024-08-17T02:27:38.935661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952005+0000","last_change":"2024-08-17T02:27:38.948764+0000","last_active":"2024-08-17T02:27:38.952005+0000","last_peered":"2024-08-17T02:27:38.952005+0000","last_clean":"2024-08-17T02:27:38.952005+0000","last_became_active":"2024-08-17T02:27:38.948461+0000","last_became_peered":"2024-08-17T02:27:38.948461+0000","last_unstale":"2024-08-17T02:27:38.952005+0000","last_undegraded":"2024-08-17T02:27:38.952005+0000","last_fullsized":"2024-08-17T02:27:38.952005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937276+0000","last_change":"2024-08-17T02:27:38.227208+0000","last_active":"2024-08-17T02:27:38.937276+0000","last_peered":"2024-08-17T02:27:38.937276+0000","last_clean":"2024-08-17T02:27:38.937276+0000","last_became_active":"2024-08-17T02:27:38.226945+0000","last_became_peered":"2024-08-17T02:27:38.226945+0000","last_unstale":"2024-08-17T02:27:38.937276+0000","last_undegraded":"2024-08-17T02:27:38.937276+0000","last_fullsized":"2024-08-17T02:27:38.937276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961809+0000","last_change":"2024-08-17T02:27:38.961180+0000","last_active":"2024-08-17T02:27:38.961809+0000","last_peered":"2024-08-17T02:27:38.961809+0000","last_clean":"2024-08-17T02:27:38.961809+0000","last_became_active":"2024-08-17T02:27:38.960913+0000","last_became_peered":"2024-08-17T02:27:38.960913+0000","last_unstale":"2024-08-17T02:27:38.961809+0000","last_undegraded":"2024-08-17T02:27:38.961809+0000","last_fullsized":"2024-08-17T02:27:38.961809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.934691+0000","last_change":"2024-08-17T02:27:38.234380+0000","last_active":"2024-08-17T02:27:38.934691+0000","last_peered":"2024-08-17T02:27:38.934691+0000","last_clean":"2024-08-17T02:27:38.934691+0000","last_became_active":"2024-08-17T02:27:38.233537+0000","last_became_peered":"2024-08-17T02:27:38.233537+0000","last_unstale":"2024-08-17T02:27:38.934691+0000","last_undegraded":"2024-08-17T02:27:38.934691+0000","last_fullsized":"2024-08-17T02:27:38.934691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943563+0000","last_change":"2024-08-17T02:27:38.940399+0000","last_active":"2024-08-17T02:27:38.943563+0000","last_peered":"2024-08-17T02:27:38.943563+0000","last_clean":"2024-08-17T02:27:38.943563+0000","last_became_active":"2024-08-17T02:27:38.939407+0000","last_became_peered":"2024-08-17T02:27:38.939407+0000","last_unstale":"2024-08-17T02:27:38.943563+0000","last_undegraded":"2024-08-17T02:27:38.943563+0000","last_fullsized":"2024-08-17T02:27:38.943563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937108+0000","last_change":"2024-08-17T02:27:38.236139+0000","last_active":"2024-08-17T02:27:38.937108+0000","last_peered":"2024-08-17T02:27:38.937108+0000","last_clean":"2024-08-17T02:27:38.937108+0000","last_became_active":"2024-08-17T02:27:38.235906+0000","last_became_peered":"2024-08-17T02:27:38.235906+0000","last_unstale":"2024-08-17T02:27:38.937108+0000","last_undegraded":"2024-08-17T02:27:38.937108+0000","last_fullsized":"2024-08-17T02:27:38.937108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961622+0000","last_change":"2024-08-17T02:27:38.955645+0000","last_active":"2024-08-17T02:27:38.961622+0000","last_peered":"2024-08-17T02:27:38.961622+0000","last_clean":"2024-08-17T02:27:38.961622+0000","last_became_active":"2024-08-17T02:27:38.955312+0000","last_became_peered":"2024-08-17T02:27:38.955312+0000","last_unstale":"2024-08-17T02:27:38.961622+0000","last_undegraded":"2024-08-17T02:27:38.961622+0000","last_fullsized":"2024-08-17T02:27:38.961622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:47.735557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932702+0000","last_change":"2024-08-17T02:27:38.237877+0000","last_active":"2024-08-17T02:27:38.932702+0000","last_peered":"2024-08-17T02:27:38.932702+0000","last_clean":"2024-08-17T02:27:38.932702+0000","last_became_active":"2024-08-17T02:27:38.237636+0000","last_became_peered":"2024-08-17T02:27:38.237636+0000","last_unstale":"2024-08-17T02:27:38.932702+0000","last_undegraded":"2024-08-17T02:27:38.932702+0000","last_fullsized":"2024-08-17T02:27:38.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954404+0000","last_change":"2024-08-17T02:27:38.950989+0000","last_active":"2024-08-17T02:27:38.954404+0000","last_peered":"2024-08-17T02:27:38.954404+0000","last_clean":"2024-08-17T02:27:38.954404+0000","last_became_active":"2024-08-17T02:27:38.950684+0000","last_became_peered":"2024-08-17T02:27:38.950684+0000","last_unstale":"2024-08-17T02:27:38.954404+0000","last_undegraded":"2024-08-17T02:27:38.954404+0000","last_fullsized":"2024-08-17T02:27:38.954404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.938295+0000","last_change":"2024-08-17T02:27:38.229546+0000","last_active":"2024-08-17T02:27:38.938295+0000","last_peered":"2024-08-17T02:27:38.938295+0000","last_clean":"2024-08-17T02:27:38.938295+0000","last_became_active":"2024-08-17T02:27:38.229068+0000","last_became_peered":"2024-08-17T02:27:38.229068+0000","last_unstale":"2024-08-17T02:27:38.938295+0000","last_undegraded":"2024-08-17T02:27:38.938295+0000","last_fullsized":"2024-08-17T02:27:38.938295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943796+0000","last_change":"2024-08-17T02:27:38.940534+0000","last_active":"2024-08-17T02:27:38.943796+0000","last_peered":"2024-08-17T02:27:38.943796+0000","last_clean":"2024-08-17T02:27:38.943796+0000","last_became_active":"2024-08-17T02:27:38.940214+0000","last_became_peered":"2024-08-17T02:27:38.940214+0000","last_unstale":"2024-08-17T02:27:38.943796+0000","last_undegraded":"2024-08-17T02:27:38.943796+0000","last_fullsized":"2024-08-17T02:27:38.943796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933106+0000","last_change":"2024-08-17T02:27:38.232881+0000","last_active":"2024-08-17T02:27:38.933106+0000","last_peered":"2024-08-17T02:27:38.933106+0000","last_clean":"2024-08-17T02:27:38.933106+0000","last_became_active":"2024-08-17T02:27:38.232605+0000","last_became_peered":"2024-08-17T02:27:38.232605+0000","last_unstale":"2024-08-17T02:27:38.933106+0000","last_undegraded":"2024-08-17T02:27:38.933106+0000","last_fullsized":"2024-08-17T02:27:38.933106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965104+0000","last_change":"2024-08-17T02:27:38.964318+0000","last_active":"2024-08-17T02:27:38.965104+0000","last_peered":"2024-08-17T02:27:38.965104+0000","last_clean":"2024-08-17T02:27:38.965104+0000","last_became_active":"2024-08-17T02:27:38.964068+0000","last_became_peered":"2024-08-17T02:27:38.964068+0000","last_unstale":"2024-08-17T02:27:38.965104+0000","last_undegraded":"2024-08-17T02:27:38.965104+0000","last_fullsized":"2024-08-17T02:27:38.965104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220792+0000","last_change":"2024-08-17T02:27:38.233166+0000","last_active":"2024-08-17T02:27:39.220792+0000","last_peered":"2024-08-17T02:27:39.220792+0000","last_clean":"2024-08-17T02:27:39.220792+0000","last_became_active":"2024-08-17T02:27:38.232772+0000","last_became_peered":"2024-08-17T02:27:38.232772+0000","last_unstale":"2024-08-17T02:27:39.220792+0000","last_undegraded":"2024-08-17T02:27:39.220792+0000","last_fullsized":"2024-08-17T02:27:39.220792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950572+0000","last_change":"2024-08-17T02:27:38.947496+0000","last_active":"2024-08-17T02:27:38.950572+0000","last_peered":"2024-08-17T02:27:38.950572+0000","last_clean":"2024-08-17T02:27:38.950572+0000","last_became_active":"2024-08-17T02:27:38.945946+0000","last_became_peered":"2024-08-17T02:27:38.945946+0000","last_unstale":"2024-08-17T02:27:38.950572+0000","last_undegraded":"2024-08-17T02:27:38.950572+0000","last_fullsized":"2024-08-17T02:27:38.950572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937161+0000","last_change":"2024-08-17T02:27:38.225331+0000","last_active":"2024-08-17T02:27:38.937161+0000","last_peered":"2024-08-17T02:27:38.937161+0000","last_clean":"2024-08-17T02:27:38.937161+0000","last_became_active":"2024-08-17T02:27:38.222853+0000","last_became_peered":"2024-08-17T02:27:38.222853+0000","last_unstale":"2024-08-17T02:27:38.937161+0000","last_undegraded":"2024-08-17T02:27:38.937161+0000","last_fullsized":"2024-08-17T02:27:38.937161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962392+0000","last_change":"2024-08-17T02:27:38.957489+0000","last_active":"2024-08-17T02:27:38.962392+0000","last_peered":"2024-08-17T02:27:38.962392+0000","last_clean":"2024-08-17T02:27:38.962392+0000","last_became_active":"2024-08-17T02:27:38.957214+0000","last_became_peered":"2024-08-17T02:27:38.957214+0000","last_unstale":"2024-08-17T02:27:38.962392+0000","last_undegraded":"2024-08-17T02:27:38.962392+0000","last_fullsized":"2024-08-17T02:27:38.962392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:19.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932946+0000","last_change":"2024-08-17T02:27:38.234553+0000","last_active":"2024-08-17T02:27:38.932946+0000","last_peered":"2024-08-17T02:27:38.932946+0000","last_clean":"2024-08-17T02:27:38.932946+0000","last_became_active":"2024-08-17T02:27:38.234040+0000","last_became_peered":"2024-08-17T02:27:38.234040+0000","last_unstale":"2024-08-17T02:27:38.932946+0000","last_undegraded":"2024-08-17T02:27:38.932946+0000","last_fullsized":"2024-08-17T02:27:38.932946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950101+0000","last_change":"2024-08-17T02:27:38.946873+0000","last_active":"2024-08-17T02:27:38.950101+0000","last_peered":"2024-08-17T02:27:38.950101+0000","last_clean":"2024-08-17T02:27:38.950101+0000","last_became_active":"2024-08-17T02:27:38.946553+0000","last_became_peered":"2024-08-17T02:27:38.946553+0000","last_unstale":"2024-08-17T02:27:38.950101+0000","last_undegraded":"2024-08-17T02:27:38.950101+0000","last_fullsized":"2024-08-17T02:27:38.950101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933576+0000","last_change":"2024-08-17T02:27:38.235261+0000","last_active":"2024-08-17T02:27:38.933576+0000","last_peered":"2024-08-17T02:27:38.933576+0000","last_clean":"2024-08-17T02:27:38.933576+0000","last_became_active":"2024-08-17T02:27:38.234975+0000","last_became_peered":"2024-08-17T02:27:38.234975+0000","last_unstale":"2024-08-17T02:27:38.933576+0000","last_undegraded":"2024-08-17T02:27:38.933576+0000","last_fullsized":"2024-08-17T02:27:38.933576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951870+0000","last_change":"2024-08-17T02:27:38.948237+0000","last_active":"2024-08-17T02:27:38.951870+0000","last_peered":"2024-08-17T02:27:38.951870+0000","last_clean":"2024-08-17T02:27:38.951870+0000","last_became_active":"2024-08-17T02:27:38.947980+0000","last_became_peered":"2024-08-17T02:27:38.947980+0000","last_unstale":"2024-08-17T02:27:38.951870+0000","last_undegraded":"2024-08-17T02:27:38.951870+0000","last_fullsized":"2024-08-17T02:27:38.951870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220208+0000","last_change":"2024-08-17T02:27:38.224385+0000","last_active":"2024-08-17T02:27:39.220208+0000","last_peered":"2024-08-17T02:27:39.220208+0000","last_clean":"2024-08-17T02:27:39.220208+0000","last_became_active":"2024-08-17T02:27:38.224112+0000","last_became_peered":"2024-08-17T02:27:38.224112+0000","last_unstale":"2024-08-17T02:27:39.220208+0000","last_undegraded":"2024-08-17T02:27:39.220208+0000","last_fullsized":"2024-08-17T02:27:39.220208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960003+0000","last_change":"2024-08-17T02:27:38.958582+0000","last_active":"2024-08-17T02:27:38.960003+0000","last_peered":"2024-08-17T02:27:38.960003+0000","last_clean":"2024-08-17T02:27:38.960003+0000","last_became_active":"2024-08-17T02:27:38.958297+0000","last_became_peered":"2024-08-17T02:27:38.958297+0000","last_unstale":"2024-08-17T02:27:38.960003+0000","last_undegraded":"2024-08-17T02:27:38.960003+0000","last_fullsized":"2024-08-17T02:27:38.960003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965620+0000","last_change":"2024-08-17T02:27:38.958334+0000","last_active":"2024-08-17T02:27:38.965620+0000","last_peered":"2024-08-17T02:27:38.965620+0000","last_clean":"2024-08-17T02:27:38.965620+0000","last_became_active":"2024-08-17T02:27:38.958023+0000","last_became_peered":"2024-08-17T02:27:38.958023+0000","last_unstale":"2024-08-17T02:27:38.965620+0000","last_undegraded":"2024-08-17T02:27:38.965620+0000","last_fullsized":"2024-08-17T02:27:38.965620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221510+0000","last_change":"2024-08-17T02:27:38.227961+0000","last_active":"2024-08-17T02:27:39.221510+0000","last_peered":"2024-08-17T02:27:39.221510+0000","last_clean":"2024-08-17T02:27:39.221510+0000","last_became_active":"2024-08-17T02:27:38.227515+0000","last_became_peered":"2024-08-17T02:27:38.227515+0000","last_unstale":"2024-08-17T02:27:39.221510+0000","last_undegraded":"2024-08-17T02:27:39.221510+0000","last_fullsized":"2024-08-17T02:27:39.221510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962441+0000","last_change":"2024-08-17T02:27:38.956122+0000","last_active":"2024-08-17T02:27:38.962441+0000","last_peered":"2024-08-17T02:27:38.962441+0000","last_clean":"2024-08-17T02:27:38.962441+0000","last_became_active":"2024-08-17T02:27:38.955849+0000","last_became_peered":"2024-08-17T02:27:38.955849+0000","last_unstale":"2024-08-17T02:27:38.962441+0000","last_undegraded":"2024-08-17T02:27:38.962441+0000","last_fullsized":"2024-08-17T02:27:38.962441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220743+0000","last_change":"2024-08-17T02:27:38.229758+0000","last_active":"2024-08-17T02:27:39.220743+0000","last_peered":"2024-08-17T02:27:39.220743+0000","last_clean":"2024-08-17T02:27:39.220743+0000","last_became_active":"2024-08-17T02:27:38.229308+0000","last_became_peered":"2024-08-17T02:27:38.229308+0000","last_unstale":"2024-08-17T02:27:39.220743+0000","last_undegraded":"2024-08-17T02:27:39.220743+0000","last_fullsized":"2024-08-17T02:27:39.220743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953549+0000","last_change":"2024-08-17T02:27:38.951247+0000","last_active":"2024-08-17T02:27:38.953549+0000","last_peered":"2024-08-17T02:27:38.953549+0000","last_clean":"2024-08-17T02:27:38.953549+0000","last_became_active":"2024-08-17T02:27:38.950979+0000","last_became_peered":"2024-08-17T02:27:38.950979+0000","last_unstale":"2024-08-17T02:27:38.953549+0000","last_undegraded":"2024-08-17T02:27:38.953549+0000","last_fullsized":"2024-08-17T02:27:38.953549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:13.804400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220328+0000","last_change":"2024-08-17T02:27:38.231845+0000","last_active":"2024-08-17T02:27:39.220328+0000","last_peered":"2024-08-17T02:27:39.220328+0000","last_clean":"2024-08-17T02:27:39.220328+0000","last_became_active":"2024-08-17T02:27:38.231535+0000","last_became_peered":"2024-08-17T02:27:38.231535+0000","last_unstale":"2024-08-17T02:27:39.220328+0000","last_undegraded":"2024-08-17T02:27:39.220328+0000","last_fullsized":"2024-08-17T02:27:39.220328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953028+0000","last_change":"2024-08-17T02:27:38.950278+0000","last_active":"2024-08-17T02:27:38.953028+0000","last_peered":"2024-08-17T02:27:38.953028+0000","last_clean":"2024-08-17T02:27:38.953028+0000","last_became_active":"2024-08-17T02:27:38.949470+0000","last_became_peered":"2024-08-17T02:27:38.949470+0000","last_unstale":"2024-08-17T02:27:38.953028+0000","last_undegraded":"2024-08-17T02:27:38.953028+0000","last_fullsized":"2024-08-17T02:27:38.953028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222977+0000","last_change":"2024-08-17T02:27:38.227009+0000","last_active":"2024-08-17T02:27:39.222977+0000","last_peered":"2024-08-17T02:27:39.222977+0000","last_clean":"2024-08-17T02:27:39.222977+0000","last_became_active":"2024-08-17T02:27:38.226613+0000","last_became_peered":"2024-08-17T02:27:38.226613+0000","last_unstale":"2024-08-17T02:27:39.222977+0000","last_undegraded":"2024-08-17T02:27:39.222977+0000","last_fullsized":"2024-08-17T02:27:39.222977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:36.242448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:43.805 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:43.805 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:27:43.805 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:27:43.805 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:27:43.806 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:27:43.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.990+0000 7fd3f5600640 1 Processor -- start 2024-08-17T02:27:43.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.990+0000 7fd3f5600640 1 -- start start 2024-08-17T02:27:43.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3f5600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3f0155a20 0x7fd3f00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3f5600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd3f006df00 0x7fd3f00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3f5600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f0156670 con 0x7fd3f0155df0 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3f5600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f00b0350 con 0x7fd3f0155a20 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3f5600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f006e5e0 con 0x7fd3f006df00 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3eea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3f0155a20 0x7fd3f00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3eea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd3f0155a20 0x7fd3f00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40414/0 (socket says 172.21.15.46:40414) 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.991+0000 7fd3eea00640 1 -- 172.21.15.46:0/1691698573 learned_addr learned my addr 172.21.15.46:0/1691698573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.992+0000 7fd3ef400640 1 --2- 172.21.15.46:0/1691698573 >> v2:172.21.15.162:3300/0 conn(0x7fd3f006df00 0x7fd3f00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.992+0000 7fd3eea00640 1 -- 172.21.15.46:0/1691698573 >> v2:172.21.15.162:3300/0 conn(0x7fd3f006df00 msgr2=0x7fd3f00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.992+0000 7fd3eea00640 1 --2- 172.21.15.46:0/1691698573 >> v2:172.21.15.162:3300/0 conn(0x7fd3f006df00 0x7fd3f00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.992+0000 7fd3eea00640 1 -- 172.21.15.46:0/1691698573 >> v1:172.21.15.162:6789/0 conn(0x7fd3f0155df0 legacy=0x7fd3f006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.992+0000 7fd3eea00640 1 -- 172.21.15.46:0/1691698573 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f006e8c0 con 0x7fd3f0155a20 2024-08-17T02:27:43.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.993+0000 7fd3eea00640 1 --2- 172.21.15.46:0/1691698573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f0155a20 0x7fd3f00adf10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3f01565e0 tx=0x7fd3e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b118c6dadf0fa58 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.993+0000 7fd3ed600640 1 -- 172.21.15.46:0/1691698573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e002adf0 con 0x7fd3f0155a20 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.993+0000 7fd3ed600640 1 -- 172.21.15.46:0/1691698573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e0032440 con 0x7fd3f0155a20 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.993+0000 7fd3ed600640 1 -- 172.21.15.46:0/1691698573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0032820 con 0x7fd3f0155a20 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 -- 172.21.15.46:0/1691698573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f0155a20 msgr2=0x7fd3f00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 --2- 172.21.15.46:0/1691698573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f0155a20 0x7fd3f00adf10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3f01565e0 tx=0x7fd3e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 -- 172.21.15.46:0/1691698573 shutdown_connections 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 --2- 172.21.15.46:0/1691698573 >> v2:172.21.15.162:3300/0 conn(0x7fd3f006df00 0x7fd3f00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 --2- 172.21.15.46:0/1691698573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f0155a20 0x7fd3f00adf10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 -- 172.21.15.46:0/1691698573 >> 172.21.15.46:0/1691698573 conn(0x7fd3f00cb9b0 msgr2=0x7fd3f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 -- 172.21.15.46:0/1691698573 shutdown_connections 2024-08-17T02:27:43.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.994+0000 7fd3f5600640 1 -- 172.21.15.46:0/1691698573 wait complete. 2024-08-17T02:27:43.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.995+0000 7fd3f5600640 1 Processor -- start 2024-08-17T02:27:43.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.995+0000 7fd3f5600640 1 -- start start 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 0x7fd3f00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 0x7fd3f00c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00a9a80 con 0x7fd3f006df00 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00a8e70 con 0x7fd3f0155df0 2024-08-17T02:27:43.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3f5600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00a9150 con 0x7fd3f0155a20 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40424/0 (socket says 172.21.15.46:40424) 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.996+0000 7fd3eea00640 1 -- 172.21.15.46:0/3715293658 learned_addr learned my addr 172.21.15.46:0/3715293658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3ef400640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 0x7fd3f00c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3ee000640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 0x7fd3f00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 -- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 msgr2=0x7fd3f00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 0x7fd3f00a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 -- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 msgr2=0x7fd3f00c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 0x7fd3f00c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 -- 172.21.15.46:0/3715293658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009450 con 0x7fd3f006df00 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3ef400640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 0x7fd3f00c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3ee000640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 0x7fd3f00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:43.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3eea00640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009210 tx=0x7fd3e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0031b30 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e0031cb0 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e003d670 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00a9430 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.997+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f0168280 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.999+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f0064db0 con 0x7fd3f006df00 2024-08-17T02:27:44.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:43.999+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd3e0039040 con 0x7fd3f006df00 2024-08-17T02:27:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.000+0000 7fd3e6000640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 0x7fd3d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.000+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3e00a2230 con 0x7fd3f006df00 2024-08-17T02:27:44.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.001+0000 7fd3ee000640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 0x7fd3d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.001+0000 7fd3ee000640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 0x7fd3d0067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00712f0 tx=0x7fd3dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.004+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd3e0070250 con 0x7fd3f006df00 2024-08-17T02:27:44.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.228+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd3f006aac0 con 0x7fd3f006df00 2024-08-17T02:27:44.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.232+0000 7fd3e6000640 1 -- 172.21.15.46:0/3715293658 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161038 (secure 0 0 0) 0x7fd3e0073870 con 0x7fd3f006df00 2024-08-17T02:27:44.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:44.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 msgr2=0x7fd3d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 0x7fd3d0067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00712f0 tx=0x7fd3dc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:44.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 msgr2=0x7fd3f0167d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009210 tx=0x7fd3e0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 shutdown_connections 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f0155df0 0x7fd3f00c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd3d0065150 0x7fd3d0067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f0155a20 0x7fd3f00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 --2- 172.21.15.46:0/3715293658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3f006df00 0x7fd3f0167d40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 >> 172.21.15.46:0/3715293658 conn(0x7fd3f00cb9b0 msgr2=0x7fd3f0156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 shutdown_connections 2024-08-17T02:27:44.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.235+0000 7fd3f5600640 1 -- 172.21.15.46:0/3715293658 wait complete. 2024-08-17T02:27:44.251 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":37026},{"type":"v1","addr":"172.21.15.162:6833","nonce":37026}]},"active_addr":"172.21.15.162:6833/37026","active_change":"2024-08-17T02:27:24.997778+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2713420307}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2338943206}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":3695090729}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1927572511}]}]} 2024-08-17T02:27:44.254 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:27:44.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:27:44.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.403+0000 7fd847200640 1 Processor -- start 2024-08-17T02:27:44.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.404+0000 7fd847200640 1 -- start start 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd847200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd847200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd848067d60 con 0x7fd8480ac780 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd847200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd848068600 con 0x7fd848158ad0 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd847200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b01d0 con 0x7fd848158ea0 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd83fe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd8480ac780 0x7fd8480af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38648/0 (socket says 172.21.15.46:38648) 2024-08-17T02:27:44.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd83fe00640 1 -- 172.21.15.46:0/446018049 learned_addr learned my addr 172.21.15.46:0/446018049 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822849093 0 0) 0x7fd848067d60 con 0x7fd8480ac780 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.405+0000 7fd846800640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd82c0034e0 con 0x7fd8480ac780 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1216205860 0 0) 0x7fd82c0034e0 con 0x7fd8480ac780 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 msgr2=0x7fd8480afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 >> v1:172.21.15.162:6789/0 conn(0x7fd848158ad0 legacy=0x7fd8480ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd848067fb0 con 0x7fd8480ac780 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7fd830001470 con 0x7fd8480ac780 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 >> v1:172.21.15.46:6789/0 conn(0x7fd8480ac780 legacy=0x7fd8480af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82c003a00 0x7fd82c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd82c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c004cc0 0x7fd82c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480b01d0 con 0x7fd82c004cc0 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00bbe0 con 0x7fd82c003a00 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00bda0 con 0x7fd848158ea0 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd83fe00640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd82c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.406+0000 7fd845e00640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82c003a00 0x7fd82c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd846800640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c004cc0 0x7fd82c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd83fe00640 1 -- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82c003a00 msgr2=0x7fd82c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd83fe00640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd82c003a00 0x7fd82c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd83fe00640 1 -- 172.21.15.46:0/446018049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c004cc0 msgr2=0x7fd82c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd83fe00640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd82c004cc0 0x7fd82c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.407+0000 7fd83fe00640 1 -- 172.21.15.46:0/446018049 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0034e0 con 0x7fd848158ea0 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.408+0000 7fd83fe00640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd82c004780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8480acb80 tx=0x7fd830001d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f1533663584ae1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.408+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005890 con 0x7fd848158ea0 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.408+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83002d070 con 0x7fd848158ea0 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.408+0000 7fd845400640 1 -- 172.21.15.46:0/446018049 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005a70 con 0x7fd848158ea0 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 -- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 msgr2=0x7fd82c004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 --2- 172.21.15.46:0/446018049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd82c004780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd8480acb80 tx=0x7fd830001d80 comp rx=0 tx=0).stop 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd846800640 1 -- 172.21.15.46:0/446018049 reap_dead start 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 -- 172.21.15.46:0/446018049 shutdown_connections 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 -- 172.21.15.46:0/446018049 >> 172.21.15.46:0/446018049 conn(0x7fd848096a70 msgr2=0x7fd848096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 -- 172.21.15.46:0/446018049 shutdown_connections 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.409+0000 7fd847200640 1 -- 172.21.15.46:0/446018049 wait complete. 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.410+0000 7fd847200640 1 Processor -- start 2024-08-17T02:27:44.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 -- start start 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848156f50 0x7fd848168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481573c0 con 0x7fd8480c7790 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.411+0000 7fd847200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c7300 con 0x7fd848156f50 2024-08-17T02:27:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd847200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd848169950 con 0x7fd848158ea0 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40442/0 (socket says 172.21.15.46:40442) 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 -- 172.21.15.46:0/3906266783 learned_addr learned my addr 172.21.15.46:0/3906266783 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd845e00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd846800640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848156f50 0x7fd848168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 -- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 msgr2=0x7fd8480c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 -- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848156f50 msgr2=0x7fd848168b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848156f50 0x7fd848168b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 -- 172.21.15.46:0/3906266783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480c6cb0 con 0x7fd8480c7790 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.412+0000 7fd83fe00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c190 tx=0x7fd830033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.413+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830041070 con 0x7fd8480c7790 2024-08-17T02:27:44.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.413+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830007280 con 0x7fd8480c7790 2024-08-17T02:27:44.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.413+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830007620 con 0x7fd8480c7790 2024-08-17T02:27:44.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.413+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c6f90 con 0x7fd8480c7790 2024-08-17T02:27:44.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.413+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8481690c0 con 0x7fd8480c7790 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.414+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd848071050 con 0x7fd8480c7790 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.415+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd83002f030 con 0x7fd8480c7790 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.415+0000 7fd83d600640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 0x7fd824067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.416+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8300a21b0 con 0x7fd8480c7790 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.416+0000 7fd845e00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 0x7fd824067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.417+0000 7fd845e00640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 0x7fd824067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd838007fd0 tx=0x7fd838007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.420+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd830070280 con 0x7fd8480c7790 2024-08-17T02:27:44.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.601+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8480c7440 con 0x7fd8480c7790 2024-08-17T02:27:44.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.602+0000 7fd83d600640 1 -- 172.21.15.46:0/3906266783 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd8300738a0 con 0x7fd8480c7790 2024-08-17T02:27:44.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:44.603 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:44.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 msgr2=0x7fd824067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 0x7fd824067630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd838007fd0 tx=0x7fd838007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 msgr2=0x7fd848156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c190 tx=0x7fd830033000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 shutdown_connections 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd848156f50 0x7fd848168b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8480c7790 0x7fd848156a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd824065180 0x7fd824067630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 --2- 172.21.15.46:0/3906266783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd848158ea0 0x7fd8480c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 >> 172.21.15.46:0/3906266783 conn(0x7fd848096a70 msgr2=0x7fd8480ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.604+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 shutdown_connections 2024-08-17T02:27:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.605+0000 7fd847200640 1 -- 172.21.15.46:0/3906266783 wait complete. 2024-08-17T02:27:44.620 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:27:44.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:44.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.770+0000 7f341c400640 1 Processor -- start 2024-08-17T02:27:44.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.770+0000 7f341c400640 1 -- start start 2024-08-17T02:27:44.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341c400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f34140b1440 0x7f34140caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341c400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3414140580 0x7f34140c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341c400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34140caa80 con 0x7f34141401b0 2024-08-17T02:27:44.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341c400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34140cb450 con 0x7f34140b1440 2024-08-17T02:27:44.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341c400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34140c9e70 con 0x7f3414140580 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f3419a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f34141401b0 0x7f34140b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38656/0 (socket says 172.21.15.46:38656) 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f3419a00640 1 -- 172.21.15.46:0/1024147709 learned_addr learned my addr 172.21.15.46:0/1024147709 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f3419000640 1 --2- 172.21.15.46:0/1024147709 >> v2:172.21.15.46:3300/0 conn(0x7f34140b1440 0x7f34140caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f341a400640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3414140580 0x7f34140c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f3413e00640 1 -- 172.21.15.46:0/1024147709 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39831606 0 0) 0x7f34140caa80 con 0x7f34141401b0 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.772+0000 7f3413e00640 1 -- 172.21.15.46:0/1024147709 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33fc0034e0 con 0x7f34141401b0 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.773+0000 7f3419000640 1 -- 172.21.15.46:0/1024147709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3414140580 msgr2=0x7f34140c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.773+0000 7f3419000640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3414140580 0x7f34140c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.773+0000 7f3419000640 1 -- 172.21.15.46:0/1024147709 >> v1:172.21.15.46:6789/0 conn(0x7f34141401b0 legacy=0x7f34140b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.773+0000 7f3419000640 1 -- 172.21.15.46:0/1024147709 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140ca150 con 0x7f34140b1440 2024-08-17T02:27:44.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f3419000640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140caf10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3400009850 tx=0x7f34000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117a76d93837b94e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f3413e00640 1 -- 172.21.15.46:0/1024147709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340002ad90 con 0x7f34140b1440 2024-08-17T02:27:44.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f3413e00640 1 -- 172.21.15.46:0/1024147709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400032440 con 0x7f34140b1440 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f3413e00640 1 -- 172.21.15.46:0/1024147709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400032820 con 0x7f34140b1440 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 -- 172.21.15.46:0/1024147709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 msgr2=0x7f34140caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140caf10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3400009850 tx=0x7f34000090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 -- 172.21.15.46:0/1024147709 shutdown_connections 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3414140580 0x7f34140c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 --2- 172.21.15.46:0/1024147709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140caf10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 -- 172.21.15.46:0/1024147709 >> 172.21.15.46:0/1024147709 conn(0x7f34140cb9b0 msgr2=0x7f34140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.774+0000 7f341c400640 1 -- 172.21.15.46:0/1024147709 shutdown_connections 2024-08-17T02:27:44.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.775+0000 7f341c400640 1 -- 172.21.15.46:0/1024147709 wait complete. 2024-08-17T02:27:44.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.776+0000 7f341c400640 1 Processor -- start 2024-08-17T02:27:44.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.776+0000 7f341c400640 1 -- start start 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34141401b0 0x7f3414169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 0x7f341415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341416a320 con 0x7f34140b1440 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34140a6cf0 con 0x7f3414140580 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341c400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3414169d60 con 0x7f34141401b0 2024-08-17T02:27:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f3419a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f3419a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40462/0 (socket says 172.21.15.46:40462) 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f3419a00640 1 -- 172.21.15.46:0/2315410245 learned_addr learned my addr 172.21.15.46:0/2315410245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f3419000640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34141401b0 0x7f3414169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.777+0000 7f341a400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 0x7f341415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 -- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34141401b0 msgr2=0x7f3414169310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34141401b0 0x7f3414169310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 -- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 msgr2=0x7f341415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 0x7f341415d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 -- 172.21.15.46:0/2315410245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009390 con 0x7f34140b1440 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f341a400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 0x7f341415d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3419a00640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f340800c5b0 tx=0x7f3408007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408005b70 con 0x7f34140b1440 2024-08-17T02:27:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408005cf0 con 0x7f34140b1440 2024-08-17T02:27:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408007340 con 0x7f34140b1440 2024-08-17T02:27:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341416a040 con 0x7f34140b1440 2024-08-17T02:27:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.778+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34140a76c0 con 0x7f34140b1440 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.779+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34140a7910 con 0x7f34140b1440 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.780+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f340801b400 con 0x7f34140b1440 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.781+0000 7f3410c00640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 0x7f33f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.781+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3408081f80 con 0x7f34140b1440 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.781+0000 7f3419000640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 0x7f33f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.782+0000 7f3419000640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 0x7f33f4067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3400034000 tx=0x7f3400032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.785+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f34140a7910 con 0x7f34140b1440 2024-08-17T02:27:44.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.969+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34140a7910 con 0x7f34140b1440 2024-08-17T02:27:44.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.970+0000 7f3410c00640 1 -- 172.21.15.46:0/2315410245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f34140a7910 con 0x7f34140b1440 2024-08-17T02:27:44.971 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:44.971 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:44.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 msgr2=0x7f33f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 0x7f33f4067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3400034000 tx=0x7f3400032000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 msgr2=0x7f34140a7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f340800c5b0 tx=0x7f3408007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 shutdown_connections 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3414140580 0x7f341415d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f33f4065150 0x7f33f4067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34141401b0 0x7f3414169310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 --2- 172.21.15.46:0/2315410245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34140b1440 0x7f34140a7180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 >> 172.21.15.46:0/2315410245 conn(0x7f34140cb9b0 msgr2=0x7f34140af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 shutdown_connections 2024-08-17T02:27:44.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:44.972+0000 7f341c400640 1 -- 172.21.15.46:0/2315410245 wait complete. 2024-08-17T02:27:44.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:27:44.989 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:27:44.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:27:44.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:27:44.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:27:44.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:27:44.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:27:44.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:27:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.262+0000 7f5781400640 1 Processor -- start 2024-08-17T02:27:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.261+0000 7fd707800640 1 Processor -- start 2024-08-17T02:27:45.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.262+0000 7f5781400640 1 -- start start 2024-08-17T02:27:45.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.263+0000 7fd707800640 1 -- start start 2024-08-17T02:27:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7f5781400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e1bd0 0x7f57740e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7f5781400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5774006150 0x7f57740065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7f5781400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57740e24e0 con 0x7f57740e5c30 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7f577be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e1bd0 0x7f57740e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f577be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e1bd0 0x7f57740e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42682/0 (socket says 172.21.15.46:42682) 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f577b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5774006150 0x7f57740065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f577b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5774006150 0x7f57740065a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60408/0 (socket says 172.21.15.46:60408) 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7fd707800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6f804f8e0 0x7fd6f80de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7f0c3c800640 1 Processor -- start 2024-08-17T02:27:45.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f0c3c800640 1 -- start start 2024-08-17T02:27:45.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f5780a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f57740e5c30 0x7f5774053cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45954/0 (socket says 172.21.15.46:45954) 2024-08-17T02:27:45.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f577be00640 1 -- 172.21.15.46:0/2392618475 learned_addr learned my addr 172.21.15.46:0/2392618475 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5774006c10 con 0x7f5774006150 2024-08-17T02:27:45.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7fd707800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f8050cd0 con 0x7fd6f80de700 2024-08-17T02:27:45.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7fd707800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f8053360 con 0x7fd6f804f510 2024-08-17T02:27:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7fd707800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f804fd30 con 0x7fd6f804f8e0 2024-08-17T02:27:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.265+0000 7fd6ffe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6f804f8e0 0x7fd6f80de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5774006ef0 con 0x7f57740e1bd0 2024-08-17T02:27:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845185552 0 0) 0x7f57740e24e0 con 0x7f57740e5c30 2024-08-17T02:27:45.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7fd704e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd6f804f510 0x7fd6f8050180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45966/0 (socket says 172.21.15.46:45966) 2024-08-17T02:27:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.266+0000 7fd704e00640 1 -- 172.21.15.46:0/2633497660 learned_addr learned my addr 172.21.15.46:0/2633497660 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57640034e0 con 0x7f57740e5c30 2024-08-17T02:27:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71077052 0 0) 0x7fd6f8050cd0 con 0x7fd6f80de700 2024-08-17T02:27:45.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e80034e0 con 0x7fd6f80de700 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762614363 0 0) 0x7f57640034e0 con 0x7f57740e5c30 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e1bd0 msgr2=0x7f57740e1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e1bd0 0x7f57740e1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 >> v2:172.21.15.162:3300/0 conn(0x7f5774006150 msgr2=0x7f57740065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 --2- 172.21.15.46:0/2392618475 >> v2:172.21.15.162:3300/0 conn(0x7f5774006150 0x7f57740065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740071d0 con 0x7f57740e5c30 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f577c04b9e0 con 0x7f57740e5c30 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 >> v1:172.21.15.162:6789/0 conn(0x7f57740e5c30 legacy=0x7f5774053cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764003a50 0x7f5764003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.267+0000 7f577aa00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5764004780 0x7f5764004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f577aa00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5764005130 0x7f576400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774006c10 con 0x7f5764004780 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774006ef0 con 0x7f5764003a50 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576400bf40 con 0x7f5764005130 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 22013851 0 0) 0x7fd6e80034e0 con 0x7fd6f80de700 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 >> v2:172.21.15.46:3300/0 conn(0x7fd6f804f8e0 msgr2=0x7fd6f80de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f5780a00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5764005130 0x7f576400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f0c3c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 0x7f0c340aa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f0c3c800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c340a98e0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f0c3c800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c340aa180 con 0x7f0c34158ac0 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.268+0000 7f0c3c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3415a2f0 con 0x7f0c34159ea0 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f0c39400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0c3406a5e0 0x7f0c340ab3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38672/0 (socket says 172.21.15.46:38672) 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f0c39400640 1 -- 172.21.15.46:0/1296828861 learned_addr learned my addr 172.21.15.46:0/1296828861 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f0c3a800640 1 --2- 172.21.15.46:0/1296828861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 0x7f0c340aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f577b400640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5764004780 0x7f5764004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7fd6ff400640 1 --2- 172.21.15.46:0/2633497660 >> v2:172.21.15.46:3300/0 conn(0x7fd6f804f8e0 0x7fd6f80de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 >> v1:172.21.15.162:6789/0 conn(0x7fd6f804f510 legacy=0x7fd6f8050180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80537f0 con 0x7fd6f80de700 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7fd700065e30 con 0x7fd6f80de700 2024-08-17T02:27:45.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7f577be00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764003a50 0x7f5764003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f0c38a00640 1 -- 172.21.15.46:0/1296828861 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243058008 0 0) 0x7f0c340aa180 con 0x7f0c34158ac0 2024-08-17T02:27:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f0c38a00640 1 -- 172.21.15.46:0/1296828861 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c1c0034e0 con 0x7f0c34158ac0 2024-08-17T02:27:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f5780a00640 1 -- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764003a50 msgr2=0x7f5764003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.269+0000 7fd6ffe00640 1 --2- 172.21.15.46:0/2633497660 >> v2:172.21.15.46:3300/0 conn(0x7fd6f804f8e0 0x7fd6f80de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 >> v1:172.21.15.46:6789/0 conn(0x7fd6f80de700 legacy=0x7fd6f8035170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 0x7fd6e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e8004780 0x7fd6e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6e8005180 0x7fd6e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f804fd30 con 0x7fd6e8005180 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e800c150 con 0x7fd6e8004780 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e800c310 con 0x7fd6e80039d0 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f0c3a800640 1 -- 172.21.15.46:0/1296828861 >> v1:172.21.15.162:6789/0 conn(0x7f0c34158ac0 legacy=0x7f0c34069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f0c3a800640 1 -- 172.21.15.46:0/1296828861 >> v1:172.21.15.46:6789/0 conn(0x7f0c3406a5e0 legacy=0x7f0c340ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f0c3a800640 1 -- 172.21.15.46:0/1296828861 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340b1980 con 0x7f0c34159ea0 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f5780a00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764003a50 0x7f5764003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f5780a00640 1 -- 172.21.15.46:0/2392618475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5764004780 msgr2=0x7f5764004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f5780a00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5764004780 0x7f5764004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.270+0000 7f5780a00640 1 -- 172.21.15.46:0/2392618475 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740071d0 con 0x7f5764005130 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.271+0000 7fd704e00640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 0x7fd6e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.271+0000 7fd6ffe00640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e8004780 0x7fd6e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7f5780a00640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5764005130 0x7f576400b9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f577c065800 tx=0x7f577c06f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9e53869485add7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7f5e14000640 1 Processor -- start 2024-08-17T02:27:45.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7f5e14000640 1 -- start start 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a2640 con 0x7f5764005130 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7fd704e00640 1 -- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e8004780 msgr2=0x7fd6e8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7fd704e00640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e8004780 0x7fd6e8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7fd704e00640 1 -- 172.21.15.46:0/2633497660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6e8005180 msgr2=0x7fd6e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7fd704e00640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6e8005180 0x7fd6e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.272+0000 7fd704e00640 1 -- 172.21.15.46:0/2633497660 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80034e0 con 0x7fd6e80039d0 2024-08-17T02:27:45.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f0c3a800640 1 --2- 172.21.15.46:0/1296828861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 0x7f0c340aa610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009880 tx=0x7f0c280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f374eda3357b0de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7fd706200640 1 -- 172.21.15.46:0/2633497660 reap_dead start 2024-08-17T02:27:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0a27c0 con 0x7f5764005130 2024-08-17T02:27:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f577aa00640 1 -- 172.21.15.46:0/2392618475 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a2c00 con 0x7f5764005130 2024-08-17T02:27:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5764005130 msgr2=0x7f576400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5781400640 1 --2- 172.21.15.46:0/2392618475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5764005130 0x7f576400b9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f577c065800 tx=0x7f577c06f710 comp rx=0 tx=0).stop 2024-08-17T02:27:45.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7fd704e00640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 0x7fd6e8003da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8004700 tx=0x7fd6f4007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92998a9872507b80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f0c38a00640 1 -- 172.21.15.46:0/1296828861 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2802ad80 con 0x7f0c34159ea0 2024-08-17T02:27:45.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f0c38a00640 1 -- 172.21.15.46:0/1296828861 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28032440 con 0x7f0c34159ea0 2024-08-17T02:27:45.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f0c38a00640 1 -- 172.21.15.46:0/1296828861 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28032820 con 0x7f0c34159ea0 2024-08-17T02:27:45.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.273+0000 7f9e4e000640 1 Processor -- start 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e14000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e14000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 0x7f5e0c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e14000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0b30e0 con 0x7f5e0c160660 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e14000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c089760 con 0x7f5e0c0ada10 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e14000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0aeca0 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f0c3c800640 1 -- 172.21.15.46:0/1296828861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 msgr2=0x7f0c340aa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f0c3c800640 1 --2- 172.21.15.46:0/1296828861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 0x7f0c340aa610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009880 tx=0x7f0c280090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5e10c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5e10c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42740/0 (socket says 172.21.15.46:42740) 2024-08-17T02:27:45.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5e10c00640 1 -- 172.21.15.46:0/2530512031 learned_addr learned my addr 172.21.15.46:0/2530512031 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f0c3c800640 1 -- 172.21.15.46:0/1296828861 shutdown_connections 2024-08-17T02:27:45.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f9e4e000640 1 -- start start 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.274+0000 7f5780a00640 1 -- 172.21.15.46:0/2392618475 reap_dead start 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 shutdown_connections 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 >> 172.21.15.46:0/2392618475 conn(0x7f577400f070 msgr2=0x7f5774058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5e12000640 1 --2- 172.21.15.46:0/2530512031 >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 0x7f5e0c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5e10c00640 1 -- 172.21.15.46:0/2530512031 >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 msgr2=0x7f5e0c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f0c3c800640 1 --2- 172.21.15.46:0/1296828861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c34159ea0 0x7f0c340aa610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f0c3c800640 1 -- 172.21.15.46:0/1296828861 >> 172.21.15.46:0/1296828861 conn(0x7f0c340cc480 msgr2=0x7f0c340687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 shutdown_connections 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f5781400640 1 -- 172.21.15.46:0/2392618475 wait complete. 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f402aa90 con 0x7fd6e80039d0 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f402ac30 con 0x7fd6e80039d0 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f0c3c800640 1 -- 172.21.15.46:0/1296828861 shutdown_connections 2024-08-17T02:27:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.275+0000 7f5e10c00640 1 --2- 172.21.15.46:0/2530512031 >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 0x7f5e0c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f5e10c00640 1 -- 172.21.15.46:0/2530512031 >> v1:172.21.15.46:6789/0 conn(0x7f5e0c160660 legacy=0x7f5e0c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f5e10c00640 1 -- 172.21.15.46:0/2530512031 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0aef80 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f5e12000640 1 --2- 172.21.15.46:0/2530512031 >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 0x7f5e0c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.276+0000 7f0c3c800640 1 -- 172.21.15.46:0/1296828861 wait complete. 2024-08-17T02:27:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e4e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e480adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e4e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e4813e730 0x7f9e480aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e4e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e480af6e0 con 0x7f9e4813e360 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e4e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e480acb40 con 0x7f9e4813e730 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e4e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480ad6c0 con 0x7f9e4806a5e0 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7fd6ff400640 1 -- 172.21.15.46:0/2633497660 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4004860 con 0x7fd6e80039d0 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e47e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e4813e730 0x7f9e480aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e47e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e4813e730 0x7f9e480aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60436/0 (socket says 172.21.15.46:60436) 2024-08-17T02:27:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.277+0000 7f9e47e00640 1 -- 172.21.15.46:0/1097882302 learned_addr learned my addr 172.21.15.46:0/1097882302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f5e10c00640 1 --2- 172.21.15.46:0/2530512031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009910 tx=0x7f5e000091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e07060aa6497cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f5781400640 1 Processor -- start 2024-08-17T02:27:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 -- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 msgr2=0x7fd6e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 0x7fd6e8003da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8004700 tx=0x7fd6f4007d90 comp rx=0 tx=0).stop 2024-08-17T02:27:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e46a00640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e480adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e47e00640 1 -- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 msgr2=0x7f9e480adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f0c3c800640 1 Processor -- start 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e47e00640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e480adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e47e00640 1 -- 172.21.15.46:0/1097882302 >> v1:172.21.15.162:6789/0 conn(0x7f9e4813e360 legacy=0x7f9e48069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e47e00640 1 -- 172.21.15.46:0/1097882302 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480acd90 con 0x7f9e4813e730 2024-08-17T02:27:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f9e46a00640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e480adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f0c3c800640 1 -- start start 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 -- 172.21.15.46:0/2633497660 shutdown_connections 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 --2- 172.21.15.46:0/2633497660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e80039d0 0x7fd6e8003da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 -- 172.21.15.46:0/2633497660 >> 172.21.15.46:0/2633497660 conn(0x7fd6f800a140 msgr2=0x7fd6f800a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 -- 172.21.15.46:0/2633497660 shutdown_connections 2024-08-17T02:27:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7fd707800640 1 -- 172.21.15.46:0/2633497660 wait complete. 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.279+0000 7f5e0be00640 1 -- 172.21.15.46:0/2530512031 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0002ae40 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.279+0000 7f5e0be00640 1 -- 172.21.15.46:0/2530512031 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00032440 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.279+0000 7f5e0be00640 1 -- 172.21.15.46:0/2530512031 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00032820 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f9e47e00640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e480aea20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000d1a0 tx=0x7f9e4000ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bd6da163dd1426 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.278+0000 7f5781400640 1 -- start start 2024-08-17T02:27:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 -- 172.21.15.46:0/2530512031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 msgr2=0x7f5e0c0b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 --2- 172.21.15.46:0/2530512031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009910 tx=0x7f5e000091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 0x7f577404c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e50f0 0x7f57740df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 -- 172.21.15.46:0/2530512031 shutdown_connections 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 --2- 172.21.15.46:0/2530512031 >> v2:172.21.15.46:3300/0 conn(0x7f5e0c0ada10 0x7f5e0c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 --2- 172.21.15.46:0/2530512031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0b0fe0 0x7f5e0c0b3570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 -- 172.21.15.46:0/2530512031 >> 172.21.15.46:0/2530512031 conn(0x7f5e0c0cfdf0 msgr2=0x7f5e0c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5e14000640 1 -- 172.21.15.46:0/2530512031 shutdown_connections 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f9e46000640 1 -- 172.21.15.46:0/1097882302 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000b2e0 con 0x7f9e4813e730 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f9e46000640 1 -- 172.21.15.46:0/1097882302 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000b440 con 0x7f9e4813e730 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f9e46000640 1 -- 172.21.15.46:0/1097882302 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40009840 con 0x7f9e4813e730 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f9e4e000640 1 -- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 msgr2=0x7f9e480aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f9e4e000640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e480aea20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000d1a0 tx=0x7f9e4000ba50 comp rx=0 tx=0).stop 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f0c3c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3406a5e0 0x7f0c34157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f0c3c800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c34158ac0 0x7f0c34152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f0c3c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 0x7f0c340af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3c800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34168a30 con 0x7f0c34158ac0 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34155fd0 con 0x7f0c34159ea0 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c341562b0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 0x7f0c340af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c39e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3406a5e0 0x7f0c34157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 0x7f0c340af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60464/0 (socket says 172.21.15.46:60464) 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f0c3a800640 1 -- 172.21.15.46:0/1748247182 learned_addr learned my addr 172.21.15.46:0/1748247182 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f9e4e000640 1 -- 172.21.15.46:0/1097882302 shutdown_connections 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f9e4e000640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e480adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f9e4e000640 1 --2- 172.21.15.46:0/1097882302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e480aea20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f9e4e000640 1 -- 172.21.15.46:0/1097882302 >> 172.21.15.46:0/1097882302 conn(0x7f9e480cc480 msgr2=0x7f9e480687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f9e4e000640 1 -- 172.21.15.46:0/1097882302 shutdown_connections 2024-08-17T02:27:45.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 -- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 msgr2=0x7f0c340af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f9e4e000640 1 -- 172.21.15.46:0/1097882302 wait complete. 2024-08-17T02:27:45.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57740e0e60 0x7f57740e12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740f7310 con 0x7f57740e0e60 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740e1810 con 0x7f5764005130 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f5781400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740e5610 con 0x7f57740e50f0 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f577be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 0x7f577404c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f577be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 0x7f577404c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60452/0 (socket says 172.21.15.46:60452) 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.280+0000 7f577be00640 1 -- 172.21.15.46:0/2536078146 learned_addr learned my addr 172.21.15.46:0/2536078146 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f577be00640 1 -- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e50f0 msgr2=0x7f57740df4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f577be00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57740e50f0 0x7f57740df4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f577be00640 1 -- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57740e0e60 msgr2=0x7f57740e12d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f577be00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57740e0e60 0x7f57740e12d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.282+0000 7f577be00640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740f69e0 con 0x7f5764005130 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 0x7f0c340af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 -- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c34158ac0 msgr2=0x7f0c34152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0c34158ac0 0x7f0c34152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009390 con 0x7f0c3406a5e0 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.281+0000 7f5e14000640 1 -- 172.21.15.46:0/2530512031 wait complete. 2024-08-17T02:27:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f5e14000640 1 Processor -- start 2024-08-17T02:27:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f577be00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 0x7f577404c630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5770011970 tx=0x7f57700091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7fd707800640 1 Processor -- start 2024-08-17T02:27:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f5e14000640 1 -- start start 2024-08-17T02:27:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c3a800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34159ea0 0x7f0c340af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f0c39e00640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3406a5e0 0x7f0c34157480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c24001010 tx=0x7f0c24007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f8436600640 1 Processor -- start 2024-08-17T02:27:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.283+0000 7f8436600640 1 -- start start 2024-08-17T02:27:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.284+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011590 con 0x7f0c3406a5e0 2024-08-17T02:27:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.284+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c34156590 con 0x7f0c3406a5e0 2024-08-17T02:27:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.284+0000 7f9e4e000640 1 Processor -- start 2024-08-17T02:27:45.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.284+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c341579c0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f9e4e000640 1 -- start start 2024-08-17T02:27:45.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.284+0000 7fd707800640 1 -- start start 2024-08-17T02:27:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770013750 con 0x7f5764005130 2024-08-17T02:27:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57700138b0 con 0x7f5764005130 2024-08-17T02:27:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770013c50 con 0x7f5764005130 2024-08-17T02:27:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 0x7fd6f80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f80caa10 0x7fd6f80381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f8436600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800de60 0x7f84280dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f8436600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428054970 con 0x7f842800da90 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f8436600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8428055210 con 0x7f84280e0000 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f8436600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842800e2b0 con 0x7f842800de60 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6f8038730 0x7fd6f80be590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8039d60 con 0x7fd6f8038730 2024-08-17T02:27:45.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c240116f0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011ab0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80bc130 con 0x7fd6e80039d0 2024-08-17T02:27:45.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.285+0000 7fd707800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80bff50 con 0x7fd6f80caa10 2024-08-17T02:27:45.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7fb22a000640 1 Processor -- start 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7f9e4e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e481547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7f8435200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f842800da90 0x7f84280358c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38690/0 (socket says 172.21.15.46:38690) 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7f8435200640 1 -- 172.21.15.46:0/1588226827 learned_addr learned my addr 172.21.15.46:0/1588226827 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7f9e4e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e4813e360 0x7f9e480a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e4e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e48157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e4e000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480a95c0 con 0x7f9e4813e360 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e4e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480a5dd0 con 0x7f9e4813e730 2024-08-17T02:27:45.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e4e000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e480a60b0 con 0x7f9e4806a5e0 2024-08-17T02:27:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f842fe00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800de60 0x7f84280dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e46a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e4813e360 0x7f9e480a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e46a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e4813e360 0x7f9e480a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40548/0 (socket says 172.21.15.46:40548) 2024-08-17T02:27:45.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e46a00640 1 -- 172.21.15.46:0/4249615780 learned_addr learned my addr 172.21.15.46:0/4249615780 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f9e47e00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e48157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745473883 0 0) 0x7f8428054970 con 0x7f842800da90 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84180034e0 con 0x7f842800da90 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f5781400640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57740f6cc0 con 0x7f5764005130 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533192545 0 0) 0x7f8428055210 con 0x7f84280e0000 2024-08-17T02:27:45.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.287+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8428054970 con 0x7f84280e0000 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 -- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 msgr2=0x7f9e481547a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e4806a5e0 0x7f9e481547a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 -- 172.21.15.46:0/4249615780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e4813e360 msgr2=0x7f9e480a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e4813e360 0x7f9e480a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4000bcf0 con 0x7f9e4813e730 2024-08-17T02:27:45.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7fb22a000640 1 -- start start 2024-08-17T02:27:45.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f5781400640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740dfa30 con 0x7f5764005130 2024-08-17T02:27:45.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0c2401c460 con 0x7f0c3406a5e0 2024-08-17T02:27:45.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f9e47e00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e48157340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e40033000 tx=0x7f9e40039000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7fd704e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 0x7fd6f80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7fd704e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 0x7fd6f80ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60470/0 (socket says 172.21.15.46:60470) 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.286+0000 7fd704e00640 1 -- 172.21.15.46:0/1181301198 learned_addr learned my addr 172.21.15.46:0/1181301198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7fd6ffe00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f80caa10 0x7fd6f80381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695105766 0 0) 0x7f84180034e0 con 0x7f842800da90 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800de60 msgr2=0x7f84280dfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f5e14000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 0x7f5e0c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f5e14000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 0x7f5e0c149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f5e14000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0c160660 0x7f5e0c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800de60 0x7f84280dfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 >> v1:172.21.15.162:6789/0 conn(0x7f84280e0000 legacy=0x7f84280556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428035fd0 con 0x7f842800da90 2024-08-17T02:27:45.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.288+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f841c001470 con 0x7f842800da90 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 >> v1:172.21.15.46:6789/0 conn(0x7f842800da90 legacy=0x7f84280358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8418004bf0 0x7f8418004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8418003720 0x7f8418003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84180145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843004c200 con 0x7f8418004bf0 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842800e2b0 con 0x7f84180040d0 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8418009aa0 con 0x7f8418003720 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 -- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f80caa10 msgr2=0x7fd6f80381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6f80caa10 0x7fd6f80381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 -- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6f8038730 msgr2=0x7fd6f80be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6f8038730 0x7fd6f80be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 -- 172.21.15.46:0/1181301198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80cae80 con 0x7fd6e80039d0 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400318e0 con 0x7f9e4813e730 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4003f070 con 0x7f9e4813e730 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40031c90 con 0x7f9e4813e730 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e480a6390 con 0x7f9e4813e730 2024-08-17T02:27:45.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7fd704e00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 0x7fd6f80ca4d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6f402a720 tx=0x7fd6f402f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f8435200640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8418004bf0 0x7f8418004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7fb22a000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2240ada10 0x7fb2240b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.289+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e48154ce0 con 0x7f9e4813e730 2024-08-17T02:27:45.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e10c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 0x7f5e0c149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7fb223400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2240ada10 0x7fb2240b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7fb223400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2240ada10 0x7fb2240b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60490/0 (socket says 172.21.15.46:60490) 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f842fe00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800de60 0x7f84280dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f8435c00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84180145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e12000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0c160660 0x7f5e0c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e10c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 0x7f5e0c149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60478/0 (socket says 172.21.15.46:60478) 2024-08-17T02:27:45.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e12000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0c160660 0x7f5e0c1566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40550/0 (socket says 172.21.15.46:40550) 2024-08-17T02:27:45.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f403e420 con 0x7fd6e80039d0 2024-08-17T02:27:45.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4038070 con 0x7fd6e80039d0 2024-08-17T02:27:45.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f403e420 con 0x7fd6e80039d0 2024-08-17T02:27:45.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e14000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0b4640 con 0x7f5e0c160660 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e14000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0b3a30 con 0x7f5e0c0b0fe0 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e14000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0b3d10 con 0x7f5e0c0ada10 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e11600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 0x7f5e0c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e11600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 0x7f5e0c155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42804/0 (socket says 172.21.15.46:42804) 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5e11600640 1 -- 172.21.15.46:0/2556588659 learned_addr learned my addr 172.21.15.46:0/2556588659 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f8435c00640 1 -- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8418003720 msgr2=0x7f8418003b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f8435c00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8418003720 0x7f8418003b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f8435c00640 1 -- 172.21.15.46:0/1588226827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8418004bf0 msgr2=0x7f8418004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f8435c00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8418004bf0 0x7f8418004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f8435c00640 1 -- 172.21.15.46:0/1588226827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180034e0 con 0x7f84180040d0 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c10000fd0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f0c2d600640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0c18065250 0x7f0c18067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb22a000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 0x7fb2240aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb22a000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240d0ab0 con 0x7fb2240b1120 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb22a000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240b00c0 con 0x7fb2240ada10 2024-08-17T02:27:45.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb22a000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240af330 con 0x7fb2240b38b0 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80391e0 con 0x7fd6e80039d0 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f5781400640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5774005320 con 0x7f5764005130 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 -- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 msgr2=0x7f5e0c149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 0x7f5e0c149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 -- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0c160660 msgr2=0x7f5e0c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e0c160660 0x7f5e0c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009450 con 0x7f5e0c0ada10 2024-08-17T02:27:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7f5e11600640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 0x7f5e0c155460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c840 tx=0x7f5e04001630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb222a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb2240b1120 0x7fb2240b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45998/0 (socket says 172.21.15.46:45998) 2024-08-17T02:27:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.291+0000 7fb222a00640 1 -- 172.21.15.46:0/4191318940 learned_addr learned my addr 172.21.15.46:0/4191318940 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e48064db0 con 0x7f9e4813e730 2024-08-17T02:27:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f80397a0 con 0x7fd6e80039d0 2024-08-17T02:27:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400ce30 con 0x7f5e0c0ada10 2024-08-17T02:27:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400a850 con 0x7f5e0c0ada10 2024-08-17T02:27:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400abd0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c24081fc0 con 0x7f0c3406a5e0 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.290+0000 7f9551c00640 1 Processor -- start 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb222000640 1 -- 172.21.15.46:0/4191318940 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270714771 0 0) 0x7fb2240d0ab0 con 0x7fb2240b1120 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb222000640 1 -- 172.21.15.46:0/4191318940 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2080034e0 con 0x7fb2240b1120 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb223400640 1 -- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 msgr2=0x7fb2240aedf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb223400640 1 --2- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 0x7fb2240aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb223400640 1 -- 172.21.15.46:0/4191318940 >> v1:172.21.15.162:6789/0 conn(0x7fb2240b1120 legacy=0x7fb2240b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f0c39400640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0c18065250 0x7f0c18067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f0c2d600640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f0c1806d3e0 0x7f0c1806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c1806fea0 con 0x7f0c1806d3e0 2024-08-17T02:27:45.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5770014650 con 0x7f5764005130 2024-08-17T02:27:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f0c3a800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f0c1806d3e0 0x7f0c1806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f8435c00640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84180145d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8430066580 tx=0x7f843006f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51103de2be5e665e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a6550 con 0x7f84180040d0 2024-08-17T02:27:45.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a66b0 con 0x7f84180040d0 2024-08-17T02:27:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7f5e10c00640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e0c0b0fe0 0x7f5e0c149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-17T02:27:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c0b3ff0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f842f400640 1 -- 172.21.15.46:0/1588226827 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a6a70 con 0x7f84180040d0 2024-08-17T02:27:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1559a0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6f403e7d0 con 0x7fd6e80039d0 2024-08-17T02:27:45.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c24007e90 con 0x7f0c3406a5e0 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.293+0000 7f9551c00640 1 -- start start 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f9551c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 0x7f954c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f9551c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f9551c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0cf9d0 con 0x7f954c0cc800 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.294+0000 7f9551c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0ceb60 con 0x7f954c0cd700 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f9551c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0cedc0 con 0x7f954c158c80 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 0x7f954c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60494/0 (socket says 172.21.15.46:60494) 2024-08-17T02:27:45.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954b400640 1 -- 172.21.15.46:0/869730451 learned_addr learned my addr 172.21.15.46:0/869730451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f0c3a800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f0c1806d3e0 0x7f0c1806f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e0c064db0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.292+0000 7fb223400640 1 -- 172.21.15.46:0/4191318940 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240b0360 con 0x7fb2240ada10 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954be00640 1 -- 172.21.15.46:0/869730451 >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 msgr2=0x7f954c0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954be00640 1 --2- 172.21.15.46:0/869730451 >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954be00640 1 -- 172.21.15.46:0/869730451 >> v1:172.21.15.46:6789/0 conn(0x7f954c0cc800 legacy=0x7f954c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954be00640 1 -- 172.21.15.46:0/869730451 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c0cf0a0 con 0x7f954c158c80 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f954b400640 1 --2- 172.21.15.46:0/869730451 >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e40003020 con 0x7f9e4813e730 2024-08-17T02:27:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7fb223400640 1 --2- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240ada10 0x7fb2240b2c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb214009850 tx=0x7fb2140090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba0f1e0584f3e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7fd6f3e00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd6e0065230 0x7fd6e00676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6f40a2320 con 0x7fd6e80039d0 2024-08-17T02:27:45.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7fd6ffe00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd6e0065230 0x7fd6e00676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7fb222000640 1 -- 172.21.15.46:0/4191318940 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21402ae40 con 0x7fb2240ada10 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f8436600640 1 -- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 msgr2=0x7f84180145d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f8436600640 1 --2- 172.21.15.46:0/1588226827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84180145d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8430066580 tx=0x7f843006f710 comp rx=0 tx=0).stop 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f8435c00640 1 -- 172.21.15.46:0/1588226827 reap_dead start 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f8436600640 1 -- 172.21.15.46:0/1588226827 shutdown_connections 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.295+0000 7f8436600640 1 -- 172.21.15.46:0/1588226827 >> 172.21.15.46:0/1588226827 conn(0x7f8428057870 msgr2=0x7f8428009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.296+0000 7f8436600640 1 -- 172.21.15.46:0/1588226827 shutdown_connections 2024-08-17T02:27:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f576f400640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f575c065220 0x7f575c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f9e3ea00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9e280652d0 0x7f9e28067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7fb222000640 1 -- 172.21.15.46:0/4191318940 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214032440 con 0x7fb2240ada10 2024-08-17T02:27:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f8436600640 1 -- 172.21.15.46:0/1588226827 wait complete. 2024-08-17T02:27:45.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7fd707800640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fd6f8038b40 0x7fd6f8003300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 --> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6f8007630 con 0x7fd6f8038b40 2024-08-17T02:27:45.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f954be00640 1 --2- 172.21.15.46:0/869730451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 0x7f954c0ce620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e60 tx=0x7f9544009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252e9dcb9a3968c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7fb222000640 1 -- 172.21.15.46:0/4191318940 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214032820 con 0x7fb2240ada10 2024-08-17T02:27:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f577b400640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f575c065220 0x7f575c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7fd6ffe00640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd6e0065230 0x7fd6e00676e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80eed20 tx=0x7fd6ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f954aa00640 1 -- 172.21.15.46:0/869730451 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544007550 con 0x7f954c158c80 2024-08-17T02:27:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f954aa00640 1 -- 172.21.15.46:0/869730451 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954402d050 con 0x7f954c158c80 2024-08-17T02:27:45.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f954aa00640 1 -- 172.21.15.46:0/869730451 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544007920 con 0x7f954c158c80 2024-08-17T02:27:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.297+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5770018030 con 0x7f5764005130 2024-08-17T02:27:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f0c39400640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0c18065250 0x7f0c18067700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c3406e7c0 tx=0x7f0c300015b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== osd.3 v2:172.21.15.46:6808/37556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0c1806fea0 con 0x7f0c1806d3e0 2024-08-17T02:27:45.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e400a3ff0 con 0x7f9e4813e730 2024-08-17T02:27:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9e3ea00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7f9e2806d4e0 0x7f9e2806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f576f400640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f575c06d3b0 0x7f575c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e2806ffa0 con 0x7f9e2806d4e0 2024-08-17T02:27:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e400a6590 con 0x7f9e4813e730 2024-08-17T02:27:45.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7fb22a000640 1 -- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240ada10 msgr2=0x7fb2240b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f575c06fe70 con 0x7f575c06d3b0 2024-08-17T02:27:45.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7fb22a000640 1 --2- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240ada10 0x7fb2240b2c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb214009850 tx=0x7fb2140090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5770050ae0 con 0x7f5764005130 2024-08-17T02:27:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9551c00640 1 -- 172.21.15.46:0/869730451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 msgr2=0x7f954c0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7f9551c00640 1 --2- 172.21.15.46:0/869730451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 0x7f954c0ce620 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e60 tx=0x7f9544009780 comp rx=0 tx=0).stop 2024-08-17T02:27:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 -- 172.21.15.46:0/4191318940 shutdown_connections 2024-08-17T02:27:45.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9e46a00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7f9e2806d4e0 0x7f9e2806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 -- 172.21.15.46:0/869730451 shutdown_connections 2024-08-17T02:27:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 --2- 172.21.15.46:0/869730451 >> v2:172.21.15.162:3300/0 conn(0x7f954c0cd700 0x7f954c0cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 --2- 172.21.15.46:0/869730451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c158c80 0x7f954c0ce620 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 -- 172.21.15.46:0/869730451 >> 172.21.15.46:0/869730451 conn(0x7f954c098e30 msgr2=0x7f954c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 --2- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 0x7fb2240aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 --2- 172.21.15.46:0/4191318940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240ada10 0x7fb2240b2c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f577b400640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f575c065220 0x7f575c0676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f576800b220 tx=0x7f5768008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 -- 172.21.15.46:0/4191318940 >> 172.21.15.46:0/4191318940 conn(0x7fb2240cfdf0 msgr2=0x7fb2240d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 -- 172.21.15.46:0/869730451 shutdown_connections 2024-08-17T02:27:45.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9e47400640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9e280652d0 0x7f9e28067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 -- 172.21.15.46:0/4191318940 shutdown_connections 2024-08-17T02:27:45.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fb22a000640 1 -- 172.21.15.46:0/4191318940 wait complete. 2024-08-17T02:27:45.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f8436600640 1 Processor -- start 2024-08-17T02:27:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7f9551c00640 1 -- 172.21.15.46:0/869730451 wait complete. 2024-08-17T02:27:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.300+0000 7f9e46a00640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7f9e2806d4e0 0x7f9e2806f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.300+0000 7f8436600640 1 -- start start 2024-08-17T02:27:45.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.300+0000 7f9e47400640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9e280652d0 0x7f9e28067780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e38001050 tx=0x7f9e38007a10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f9551c00640 1 Processor -- start 2024-08-17T02:27:45.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== osd.4 v2:172.21.15.162:6816/37608 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9e2806ffa0 con 0x7f9e2806d4e0 2024-08-17T02:27:45.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84280d5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.298+0000 7fd706200640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fd6f8038b40 0x7fd6f8003300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.299+0000 7fd706200640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fd6f8038b40 0x7fd6f8003300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f9551c00640 1 -- start start 2024-08-17T02:27:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 0x7f954c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== osd.1 v2:172.21.15.46:6800/37552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd6f8007630 con 0x7fd6f8038b40 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cd700 0x7f954c0c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954c158c80 0x7f954c163870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0b20c0 con 0x7f954c158c80 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c51d0 con 0x7f954c0cc800 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0c4470 con 0x7f954c0cd700 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f9551200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954c158c80 0x7f954c163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f954be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 0x7f954c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f954be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 0x7f954c0b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60508/0 (socket says 172.21.15.46:60508) 2024-08-17T02:27:45.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f954be00640 1 -- 172.21.15.46:0/824355833 learned_addr learned my addr 172.21.15.46:0/824355833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f954b400640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cd700 0x7f954c0c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7fb22a000640 1 Processor -- start 2024-08-17T02:27:45.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f954be00640 1 -- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cd700 msgr2=0x7f954c0c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f954be00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cd700 0x7f954c0c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f954be00640 1 -- 172.21.15.46:0/824355833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954c158c80 msgr2=0x7f954c163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f954be00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954c158c80 0x7f954c163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f954be00640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c009450 con 0x7f954c0cc800 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f9551200640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f954c158c80 0x7f954c163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7fb22a000640 1 -- start start 2024-08-17T02:27:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.304+0000 7f954be00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 0x7f954c0b4d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f95440099f0 tx=0x7f9544037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e04012420 con 0x7f5e0c0ada10 2024-08-17T02:27:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.304+0000 7f5e08c00640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5dec065150 0x7f5dec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84280d5c30 0x7f84280d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 0x7f842804de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280dae90 con 0x7f84280d5c30 2024-08-17T02:27:45.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84280da560 con 0x7f84180040d0 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.301+0000 7f8436600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84280da840 con 0x7f842800a490 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 0x7f842804de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 0x7f842804de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42854/0 (socket says 172.21.15.46:42854) 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 -- 172.21.15.46:0/3818391459 learned_addr learned my addr 172.21.15.46:0/3818391459 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435200640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84280d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 -- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 msgr2=0x7f84280d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84180040d0 0x7f84280d5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 -- 172.21.15.46:0/3818391459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84280d5c30 msgr2=0x7f84280d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84280d5c30 0x7f84280d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.302+0000 7f8435c00640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84280dab20 con 0x7f842800a490 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8435c00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 0x7f842804de50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8430065800 tx=0x7f84300aa000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300b5070 con 0x7f842800a490 2024-08-17T02:27:45.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a6e60 con 0x7f842800a490 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300afba0 con 0x7f842800a490 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842804e390 con 0x7f842800a490 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.303+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84280086b0 con 0x7f842800a490 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.304+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84280da9b0 con 0x7f842800a490 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2240ada10 0x7fb22415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 0x7fb2241538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 0x7fb224156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415c440 con 0x7fb2240ada10 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415bba0 con 0x7fb2240b1120 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7fb22a000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415be80 con 0x7fb2240b38b0 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7f5780a00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f575c06d3b0 0x7f575c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7fb223400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2240ada10 0x7fb22415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7fb222a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 0x7fb2241538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7fb222a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 0x7fb2241538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60516/0 (socket says 172.21.15.46:60516) 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7fb222a00640 1 -- 172.21.15.46:0/125464269 learned_addr learned my addr 172.21.15.46:0/125464269 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544031960 con 0x7f954c0cc800 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544031ae0 con 0x7f954c0cc800 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544031ea0 con 0x7f954c0cc800 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7f9551c00640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9544009a20 con 0x7f954c0cc800 2024-08-17T02:27:45.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7f9551c00640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c0c3760 con 0x7f954c0cc800 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7f5780a00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f575c06d3b0 0x7f575c06f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.305+0000 7f5e10c00640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5dec065150 0x7f5dec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e040827c0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f5e08c00640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f5dec06d360 0x7f5dec06f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dec06fe20 con 0x7f5dec06d360 2024-08-17T02:27:45.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.306+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e04084cc0 con 0x7f5e0c0ada10 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7f5e12000640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f5dec06d360 0x7f5dec06f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7fb223400640 1 -- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 msgr2=0x7fb224156c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7fb223400640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2240b38b0 0x7fb224156c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.307+0000 7fb223400640 1 -- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 msgr2=0x7fb2241538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7fb223400640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 0x7fb2241538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7fb223400640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009390 con 0x7fb2240ada10 2024-08-17T02:27:45.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f954c071050 con 0x7f954c0cc800 2024-08-17T02:27:45.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7fb222a00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2240b1120 0x7fb2241538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:45.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f84300a53e0 con 0x7f842800a490 2024-08-17T02:27:45.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== osd.0 v2:172.21.15.46:6823/37558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f575c06fe70 con 0x7f575c06d3b0 2024-08-17T02:27:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7f5e12000640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f5dec06d360 0x7f5dec06f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.308+0000 7fb223400640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2240ada10 0x7fb22415b350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb214031000 tx=0x7fb214032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.309+0000 7f5e10c00640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5dec065150 0x7f5dec067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e00034000 tx=0x7f5e00032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.309+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214031a60 con 0x7fb2240ada10 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214031c00 con 0x7fb2240ada10 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21403b400 con 0x7fb2240ada10 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22415c160 con 0x7fb2240ada10 2024-08-17T02:27:45.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22415b890 con 0x7fb2240ada10 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7f8423e00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84100652a0 0x7f8410067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8430119ac0 con 0x7f842800a490 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.311+0000 7f8423e00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f841006d4b0 0x7f841006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.311+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f841006ff70 con 0x7f841006d4b0 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.310+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f954403c420 con 0x7f954c0cc800 2024-08-17T02:27:45.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.311+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f843011e220 con 0x7f842800a490 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.311+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb22415bfc0 con 0x7fb2240ada10 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== osd.2 v2:172.21.15.46:6809/37554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5dec06fe20 con 0x7f5dec06d360 2024-08-17T02:27:45.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f842fe00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f841006d4b0 0x7f841006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f9543400640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f952c0652a0 0x7f952c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95440a3d70 con 0x7f954c0cc800 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f8435200640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84100652a0 0x7f8410067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f9543400640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f952c06d4b0 0x7f952c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f952c06ff70 con 0x7f952c06d4b0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95440a62b0 con 0x7f954c0cc800 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.312+0000 7f954b400640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f952c0652a0 0x7f952c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.313+0000 7f8435200640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84100652a0 0x7f8410067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841c005b80 tx=0x7f841c001500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.313+0000 7f842fe00640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f841006d4b0 0x7f841006f8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.314+0000 7f9551200640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f952c06d4b0 0x7f952c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.314+0000 7f954b400640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f952c0652a0 0x7f952c067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f954c15c790 tx=0x7f953c0091d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.314+0000 7f9551200640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f952c06d4b0 0x7f952c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.314+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb214043030 con 0x7fb2240ada10 2024-08-17T02:27:45.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.314+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== osd.7 v2:172.21.15.162:6824/37634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f841006ff70 con 0x7f841006d4b0 2024-08-17T02:27:45.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.315+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== osd.6 v2:172.21.15.162:6808/37607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f952c06ff70 con 0x7f952c06d4b0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.316+0000 7fb21aa00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb204065220 0x7fb2040676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.316+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb214041070 con 0x7fb2240ada10 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.316+0000 7fb21aa00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7fb20406d430 0x7fb20406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.316+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb20406fef0 con 0x7fb20406d430 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.316+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2140a3220 con 0x7fb2240ada10 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.318+0000 7fb223e00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7fb20406d430 0x7fb20406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.319+0000 7fb223e00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7fb20406d430 0x7fb20406f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.320+0000 7fb222a00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb204065220 0x7fb2040676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.320+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== osd.5 v2:172.21.15.162:6800/37606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb20406fef0 con 0x7fb20406d430 2024-08-17T02:27:45.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.320+0000 7fb222a00640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb204065220 0x7fb2040676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb210007fd0 tx=0x7fb210009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.331+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 --> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e480a5a10 con 0x7f9e2806d4e0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.331+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 --> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c10002c70 con 0x7f0c1806d3e0 2024-08-17T02:27:45.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.332+0000 7f9e3ea00640 1 -- 172.21.15.46:0/4249615780 <== osd.4 v2:172.21.15.162:6816/37608 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e480a5a10 con 0x7f9e2806d4e0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.334+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 --> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e0c14a3c0 con 0x7f5dec06d360 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.334+0000 7f0c2d600640 1 -- 172.21.15.46:0/1748247182 <== osd.3 v2:172.21.15.46:6808/37556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c10002c70 con 0x7f0c1806d3e0 2024-08-17T02:27:45.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.334+0000 7f5e08c00640 1 -- 172.21.15.46:0/2556588659 <== osd.2 v2:172.21.15.46:6809/37554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e0c14a3c0 con 0x7f5dec06d360 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.334+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7f9e2806d4e0 msgr2=0x7f9e2806f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.334+0000 7f9e4e000640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7f9e2806d4e0 0x7f9e2806f8f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9e280652d0 msgr2=0x7f9e28067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9e280652d0 0x7f9e28067780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e38001050 tx=0x7f9e38007a10 comp rx=0 tx=0).stop 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 msgr2=0x7f9e48157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 --2- 172.21.15.46:0/4249615780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4813e730 0x7f9e48157340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e40033000 tx=0x7f9e40039000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e47e00640 1 -- 172.21.15.46:0/4249615780 reap_dead start 2024-08-17T02:27:45.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f0c1806d3e0 msgr2=0x7f0c1806f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 shutdown_connections 2024-08-17T02:27:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 >> 172.21.15.46:0/4249615780 conn(0x7f9e480cc480 msgr2=0x7f9e4813adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f0c1806d3e0 0x7f0c1806f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 shutdown_connections 2024-08-17T02:27:45.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f9e4e000640 1 -- 172.21.15.46:0/4249615780 wait complete. 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0c18065250 msgr2=0x7f0c18067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0c18065250 0x7f0c18067700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c3406e7c0 tx=0x7f0c300015b0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3406a5e0 msgr2=0x7f0c34157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.335+0000 7f0c3c800640 1 --2- 172.21.15.46:0/1748247182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3406a5e0 0x7f0c34157480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c24001010 tx=0x7f0c24007d50 comp rx=0 tx=0).stop 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f5dec06d360 msgr2=0x7f5dec06f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f5dec06d360 0x7f5dec06f770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f0c3a800640 1 -- 172.21.15.46:0/1748247182 reap_dead start 2024-08-17T02:27:45.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 --> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6f80c0cf0 con 0x7fd6f8038b40 2024-08-17T02:27:45.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5dec065150 msgr2=0x7f5dec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5dec065150 0x7f5dec067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e00034000 tx=0x7f5e00032000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 msgr2=0x7f5e0c155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e14000640 1 --2- 172.21.15.46:0/2556588659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e0c0ada10 0x7f5e0c155460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c840 tx=0x7f5e04001630 comp rx=0 tx=0).stop 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f5e12000640 1 -- 172.21.15.46:0/2556588659 reap_dead start 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 shutdown_connections 2024-08-17T02:27:45.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.336+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 >> 172.21.15.46:0/1748247182 conn(0x7f0c340cc480 msgr2=0x7f0c340b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 shutdown_connections 2024-08-17T02:27:45.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 >> 172.21.15.46:0/2556588659 conn(0x7f5e0c0cfdf0 msgr2=0x7f5e0c15ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 shutdown_connections 2024-08-17T02:27:45.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 shutdown_connections 2024-08-17T02:27:45.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7fd6f3e00640 1 -- 172.21.15.46:0/1181301198 <== osd.1 v2:172.21.15.46:6800/37552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6f80c0cf0 con 0x7fd6f8038b40 2024-08-17T02:27:45.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f5e14000640 1 -- 172.21.15.46:0/2556588659 wait complete. 2024-08-17T02:27:45.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.337+0000 7f0c3c800640 1 -- 172.21.15.46:0/1748247182 wait complete. 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.338+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fd6f8038b40 msgr2=0x7fd6f8003300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.338+0000 7fd707800640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fd6f8038b40 0x7fd6f8003300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd6e0065230 msgr2=0x7fd6e00676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd6e0065230 0x7fd6e00676e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80eed20 tx=0x7fd6ec008040 comp rx=0 tx=0).stop 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 msgr2=0x7fd6f80ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 --2- 172.21.15.46:0/1181301198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e80039d0 0x7fd6f80ca4d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6f402a720 tx=0x7fd6f402f000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd706200640 1 -- 172.21.15.46:0/1181301198 reap_dead start 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 shutdown_connections 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.339+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 >> 172.21.15.46:0/1181301198 conn(0x7fd6f800a140 msgr2=0x7fd6f80c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.340+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 shutdown_connections 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.340+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 --> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8428007960 con 0x7f841006d4b0 2024-08-17T02:27:45.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.340+0000 7fd707800640 1 -- 172.21.15.46:0/1181301198 wait complete. 2024-08-17T02:27:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.341+0000 7f8423e00640 1 -- 172.21.15.46:0/3818391459 <== osd.7 v2:172.21.15.162:6824/37634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8428007960 con 0x7f841006d4b0 2024-08-17T02:27:45.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f5781400640 1 -- 172.21.15.46:0/2536078146 --> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57740e5a10 con 0x7f575c06d3b0 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f841006d4b0 msgr2=0x7f841006f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f841006d4b0 0x7f841006f8c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84100652a0 msgr2=0x7f8410067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84100652a0 0x7f8410067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841c005b80 tx=0x7f841c001500 comp rx=0 tx=0).stop 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 msgr2=0x7f842804de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8436600640 1 --2- 172.21.15.46:0/3818391459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842800a490 0x7f842804de50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8430065800 tx=0x7f84300aa000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.342+0000 7f8435c00640 1 -- 172.21.15.46:0/3818391459 reap_dead start 2024-08-17T02:27:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.343+0000 7f576f400640 1 -- 172.21.15.46:0/2536078146 <== osd.0 v2:172.21.15.46:6823/37558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57740e5a10 con 0x7f575c06d3b0 2024-08-17T02:27:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.343+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 shutdown_connections 2024-08-17T02:27:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.343+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 >> 172.21.15.46:0/3818391459 conn(0x7f8428057870 msgr2=0x7f84280381e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.343+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 shutdown_connections 2024-08-17T02:27:45.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.343+0000 7f8436600640 1 -- 172.21.15.46:0/3818391459 wait complete. 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f575c06d3b0 msgr2=0x7f575c06f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f575c06d3b0 0x7f575c06f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f575c065220 msgr2=0x7f575c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f575c065220 0x7f575c0676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f576800b220 tx=0x7f5768008040 comp rx=0 tx=0).stop 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 msgr2=0x7f577404c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.345+0000 7f576cc00640 1 --2- 172.21.15.46:0/2536078146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5764005130 0x7f577404c630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5770011970 tx=0x7f57700091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.348+0000 7f5780a00640 1 -- 172.21.15.46:0/2536078146 reap_dead start 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.348+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 shutdown_connections 2024-08-17T02:27:45.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.348+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 >> 172.21.15.46:0/2536078146 conn(0x7f577400f070 msgr2=0x7f57740e0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.348+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 --> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f954c0cbaf0 con 0x7f952c06d4b0 2024-08-17T02:27:45.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.348+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 shutdown_connections 2024-08-17T02:27:45.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.349+0000 7f576cc00640 1 -- 172.21.15.46:0/2536078146 wait complete. 2024-08-17T02:27:45.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.351+0000 7f9543400640 1 -- 172.21.15.46:0/824355833 <== osd.6 v2:172.21.15.162:6808/37607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f954c0cbaf0 con 0x7f952c06d4b0 2024-08-17T02:27:45.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.351+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 --> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb224064db0 con 0x7fb20406d430 2024-08-17T02:27:45.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f952c06d4b0 msgr2=0x7f952c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f952c06d4b0 0x7f952c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7fb21aa00640 1 -- 172.21.15.46:0/125464269 <== osd.5 v2:172.21.15.162:6800/37606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb224064db0 con 0x7fb20406d430 2024-08-17T02:27:45.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f952c0652a0 msgr2=0x7f952c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f952c0652a0 0x7f952c067750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f954c15c790 tx=0x7f953c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 msgr2=0x7f954c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 --2- 172.21.15.46:0/824355833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c0cc800 0x7f954c0b4d00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f95440099f0 tx=0x7f9544037000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9551200640 1 -- 172.21.15.46:0/824355833 reap_dead start 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 shutdown_connections 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.352+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 >> 172.21.15.46:0/824355833 conn(0x7f954c098e30 msgr2=0x7f954c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7fb20406d430 msgr2=0x7fb20406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7fb20406d430 0x7fb20406f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb204065220 msgr2=0x7fb2040676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb204065220 0x7fb2040676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb210007fd0 tx=0x7fb210009040 comp rx=0 tx=0).stop 2024-08-17T02:27:45.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2240ada10 msgr2=0x7fb22415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb22a000640 1 --2- 172.21.15.46:0/125464269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2240ada10 0x7fb22415b350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb214031000 tx=0x7fb214032000 comp rx=0 tx=0).stop 2024-08-17T02:27:45.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 shutdown_connections 2024-08-17T02:27:45.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7fb223e00640 1 -- 172.21.15.46:0/125464269 reap_dead start 2024-08-17T02:27:45.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.354+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 shutdown_connections 2024-08-17T02:27:45.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.353+0000 7f9540c00640 1 -- 172.21.15.46:0/824355833 wait complete. 2024-08-17T02:27:45.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.354+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 >> 172.21.15.46:0/125464269 conn(0x7fb2240cfdf0 msgr2=0x7fb224155070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.354+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 shutdown_connections 2024-08-17T02:27:45.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.354+0000 7fb22a000640 1 -- 172.21.15.46:0/125464269 wait complete. 2024-08-17T02:27:45.392 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:45.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:45.393 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:45.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:45.394 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:45.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:45.395 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:45.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:45.396 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:45.396 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:45.397 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:45.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:45.398 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:45.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:45.399 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:45.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:45.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.699+0000 7fa996e00640 1 Processor -- start 2024-08-17T02:27:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.699+0000 7f8df4800640 1 Processor -- start 2024-08-17T02:27:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.700+0000 7fa996e00640 1 -- start start 2024-08-17T02:27:45.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.701+0000 7ff93e000640 1 Processor -- start 2024-08-17T02:27:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.701+0000 7ff93e000640 1 -- start start 2024-08-17T02:27:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.700+0000 7f8df4800640 1 -- start start 2024-08-17T02:27:45.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.702+0000 7f8df4800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dec0aedc0 0x7f8dec15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7f8df1400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8dec13b4e0 0x7f8dec0ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46010/0 (socket says 172.21.15.46:46010) 2024-08-17T02:27:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7f8df2800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dec0aedc0 0x7f8dec15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7fa996e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa99013b110 0x7fa990069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7fa996e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa990069a90 0x7fa9900ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7f8df2800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8dec0aedc0 0x7f8dec15fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40614/0 (socket says 172.21.15.46:40614) 2024-08-17T02:27:45.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.703+0000 7f8df1400640 1 -- 172.21.15.46:0/2034282385 learned_addr learned my addr 172.21.15.46:0/2034282385 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec06ab20 con 0x7f8dec13b110 2024-08-17T02:27:45.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec069c60 con 0x7f8dec13b4e0 2024-08-17T02:27:45.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec06afb0 con 0x7f8dec0aedc0 2024-08-17T02:27:45.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7fa996e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006ab20 con 0x7fa99013b4e0 2024-08-17T02:27:45.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7fa996e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99006afb0 con 0x7fa99013b110 2024-08-17T02:27:45.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.704+0000 7fa996e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa990069f10 con 0x7fa990069a90 2024-08-17T02:27:45.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7ff93e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7f8df2800640 1 -- 172.21.15.46:0/2034282385 >> v1:172.21.15.162:6789/0 conn(0x7f8dec13b4e0 legacy=0x7f8dec0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7f8df2800640 1 -- 172.21.15.46:0/2034282385 >> v1:172.21.15.46:6789/0 conn(0x7f8dec13b110 legacy=0x7f8dec069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7ff936a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.706+0000 7ff936a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40630/0 (socket says 172.21.15.46:40630) 2024-08-17T02:27:45.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7fa994e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa99013b4e0 0x7fa9900b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38700/0 (socket says 172.21.15.46:38700) 2024-08-17T02:27:45.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7fa994e00640 1 -- 172.21.15.46:0/372409101 learned_addr learned my addr 172.21.15.46:0/372409101 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7fa98f400640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa990069a90 0x7fa9900ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.705+0000 7fa98fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa99013b110 0x7fa990069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.706+0000 7f8df2800640 1 -- 172.21.15.46:0/2034282385 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec069f10 con 0x7f8dec0aedc0 2024-08-17T02:27:45.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.706+0000 7ff936a00640 1 -- 172.21.15.46:0/98161618 learned_addr learned my addr 172.21.15.46:0/98161618 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.706+0000 7ff93e000640 1 --2- 172.21.15.46:0/98161618 >> v2:172.21.15.162:3300/0 conn(0x7ff93004f1d0 0x7ff9300de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7ff937e00640 1 --2- 172.21.15.46:0/98161618 >> v2:172.21.15.162:3300/0 conn(0x7ff93004f1d0 0x7ff9300de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7f8df2800640 1 --2- 172.21.15.46:0/2034282385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec0aedc0 0x7f8dec15fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0078f0 tx=0x7f8ddc005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7565a5bf7334a885 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7fa98fe00640 1 -- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa990069a90 msgr2=0x7fa9900ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7fa98fe00640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa990069a90 0x7fa9900ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.708+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff930053840 con 0x7ff9300d86d0 2024-08-17T02:27:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.708+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300df740 con 0x7ff9300504b0 2024-08-17T02:27:45.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.708+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300dec40 con 0x7ff93004f1d0 2024-08-17T02:27:45.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7fa98fe00640 1 -- 172.21.15.46:0/372409101 >> v1:172.21.15.46:6789/0 conn(0x7fa99013b4e0 legacy=0x7fa9900b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.708+0000 7f8df0a00640 1 -- 172.21.15.46:0/2034282385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc009410 con 0x7f8dec0aedc0 2024-08-17T02:27:45.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.707+0000 7fa98fe00640 1 -- 172.21.15.46:0/372409101 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99006a1f0 con 0x7fa99013b110 2024-08-17T02:27:45.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.709+0000 7ff936000640 1 -- 172.21.15.46:0/98161618 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483524926 0 0) 0x7ff930053840 con 0x7ff9300d86d0 2024-08-17T02:27:45.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.709+0000 7f8df0a00640 1 -- 172.21.15.46:0/2034282385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc02e050 con 0x7f8dec0aedc0 2024-08-17T02:27:45.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.710+0000 7fa98fe00640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa990069550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa980007b50 tx=0x7fa98000d990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897ce4ada7213b39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.709+0000 7f8df0a00640 1 -- 172.21.15.46:0/2034282385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0097a0 con 0x7f8dec0aedc0 2024-08-17T02:27:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.710+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec0aedc0 msgr2=0x7f8dec15fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.710+0000 7f8df4800640 1 --2- 172.21.15.46:0/2034282385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec0aedc0 0x7f8dec15fd50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0078f0 tx=0x7f8ddc005e70 comp rx=0 tx=0).stop 2024-08-17T02:27:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7ff936000640 1 -- 172.21.15.46:0/98161618 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9200034e0 con 0x7ff9300d86d0 2024-08-17T02:27:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7ff937e00640 1 -- 172.21.15.46:0/98161618 >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 msgr2=0x7ff930005e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 shutdown_connections 2024-08-17T02:27:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7f8df4800640 1 --2- 172.21.15.46:0/2034282385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec0aedc0 0x7f8dec15fd50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7ff937e00640 1 --2- 172.21.15.46:0/98161618 >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7ff937e00640 1 -- 172.21.15.46:0/98161618 >> v1:172.21.15.46:6789/0 conn(0x7ff9300d86d0 legacy=0x7ff93004fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 >> 172.21.15.46:0/2034282385 conn(0x7f8dec0cb7a0 msgr2=0x7f8dec0cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 shutdown_connections 2024-08-17T02:27:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.712+0000 7ff937e00640 1 -- 172.21.15.46:0/98161618 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930053380 con 0x7ff93004f1d0 2024-08-17T02:27:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.711+0000 7f8df4800640 1 -- 172.21.15.46:0/2034282385 wait complete. 2024-08-17T02:27:45.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.712+0000 7fa98ea00640 1 -- 172.21.15.46:0/372409101 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980005c60 con 0x7fa99013b110 2024-08-17T02:27:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.712+0000 7ff936a00640 1 --2- 172.21.15.46:0/98161618 >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.713+0000 7fa98ea00640 1 -- 172.21.15.46:0/372409101 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980031050 con 0x7fa99013b110 2024-08-17T02:27:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.713+0000 7fa98ea00640 1 -- 172.21.15.46:0/372409101 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800070d0 con 0x7fa99013b110 2024-08-17T02:27:45.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.713+0000 7ff937e00640 1 --2- 172.21.15.46:0/98161618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93004f1d0 0x7ff9300de700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff93804ca10 tx=0x7ff938064990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f41876b513debc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.713+0000 7f8df4800640 1 Processor -- start 2024-08-17T02:27:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.713+0000 7f89a6600640 1 Processor -- start 2024-08-17T02:27:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7ff936000640 1 -- 172.21.15.46:0/98161618 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380a2ea0 con 0x7ff93004f1d0 2024-08-17T02:27:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 -- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 msgr2=0x7fa990069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa990069550 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa980007b50 tx=0x7fa98000d990 comp rx=0 tx=0).stop 2024-08-17T02:27:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7ff936000640 1 -- 172.21.15.46:0/98161618 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380a5050 con 0x7ff93004f1d0 2024-08-17T02:27:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7ff936000640 1 -- 172.21.15.46:0/98161618 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93806b2e0 con 0x7ff93004f1d0 2024-08-17T02:27:45.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7f89a6600640 1 -- start start 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 -- 172.21.15.46:0/372409101 shutdown_connections 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa990069a90 0x7fa9900ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 --2- 172.21.15.46:0/372409101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa990069550 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 -- 172.21.15.46:0/372409101 >> 172.21.15.46:0/372409101 conn(0x7fa9900cb7a0 msgr2=0x7fa9900cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 -- 172.21.15.46:0/372409101 shutdown_connections 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.714+0000 7fa996e00640 1 -- 172.21.15.46:0/372409101 wait complete. 2024-08-17T02:27:45.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.715+0000 7f8df4800640 1 -- start start 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93004f1d0 msgr2=0x7ff9300de700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7ff93e000640 1 --2- 172.21.15.46:0/98161618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93004f1d0 0x7ff9300de700 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff93804ca10 tx=0x7ff938064990 comp rx=0 tx=0).stop 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 shutdown_connections 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 --2- 172.21.15.46:0/98161618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93004f1d0 0x7ff9300de700 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 --2- 172.21.15.46:0/98161618 >> v2:172.21.15.46:3300/0 conn(0x7ff9300504b0 0x7ff930005e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 >> 172.21.15.46:0/98161618 conn(0x7ff930051600 msgr2=0x7ff930051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7fa996e00640 1 Processor -- start 2024-08-17T02:27:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7fa996e00640 1 -- start start 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dec0aedc0 0x7f8dec13d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec13b110 0x7f8dec139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15daa0 con 0x7f8dec13b110 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15dd80 con 0x7f8dec0aedc0 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f8df4800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec1589e0 con 0x7f8dec13b4e0 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f8df2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f8df2800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42910/0 (socket says 172.21.15.46:42910) 2024-08-17T02:27:45.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f8df2800640 1 -- 172.21.15.46:0/3049370293 learned_addr learned my addr 172.21.15.46:0/3049370293 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.715+0000 7f89a6600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89a00ceb40 0x7f89a00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a0162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a6600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00cadc0 con 0x7f89a0159ca0 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a6600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00cd6e0 con 0x7f89a00ceb40 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00ccf70 con 0x7f89a00ccad0 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a5200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f89a0159ca0 0x7f89a00ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38716/0 (socket says 172.21.15.46:38716) 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f89a5200640 1 -- 172.21.15.46:0/1990017541 learned_addr learned my addr 172.21.15.46:0/1990017541 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.716+0000 7f899fe00640 1 --2- 172.21.15.46:0/1990017541 >> v2:172.21.15.162:3300/0 conn(0x7f89a00ceb40 0x7f89a00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f89a5c00640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a0162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f23e9a00640 1 Processor -- start 2024-08-17T02:27:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f23e9a00640 1 -- start start 2024-08-17T02:27:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7f899fe00640 1 -- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 msgr2=0x7f89a0162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df1e00640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dec0aedc0 0x7f8dec13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df1400640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec13b110 0x7f8dec139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df2800640 1 -- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dec0aedc0 msgr2=0x7f8dec13d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df2800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dec0aedc0 0x7f8dec13d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df2800640 1 -- 172.21.15.46:0/3049370293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec13b110 msgr2=0x7f8dec139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df2800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec13b110 0x7f8dec139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f8df2800640 1 -- 172.21.15.46:0/3049370293 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0074b0 con 0x7f8dec13b4e0 2024-08-17T02:27:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7fa996e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa9900ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7fa996e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 0x7fa990139320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7fa996e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f899f400640 1 -- 172.21.15.46:0/1990017541 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871616701 0 0) 0x7f89a00cadc0 con 0x7f89a0159ca0 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7f23e9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40af9a0 0x7f23e40acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7f23e9a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e40ae250 con 0x7f23e406db70 2024-08-17T02:27:45.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7f23e9a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e40ad640 con 0x7f23e406d7a0 2024-08-17T02:27:45.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7fa98fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa9900ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7fa98fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa9900ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60574/0 (socket says 172.21.15.46:60574) 2024-08-17T02:27:45.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7f23e9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e40ad450 con 0x7f23e40af9a0 2024-08-17T02:27:45.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7fa994e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.719+0000 7fa994e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40650/0 (socket says 172.21.15.46:40650) 2024-08-17T02:27:45.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f899fe00640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a0162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f899fe00640 1 -- 172.21.15.46:0/1990017541 >> v1:172.21.15.46:6789/0 conn(0x7f89a0159ca0 legacy=0x7f89a00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.718+0000 7f899fe00640 1 -- 172.21.15.46:0/1990017541 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00cb060 con 0x7f89a00ceb40 2024-08-17T02:27:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa98f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 0x7fa990139320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa98f400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 0x7fa990139320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42920/0 (socket says 172.21.15.46:42920) 2024-08-17T02:27:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f23e3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f23e406d7a0 0x7f23e406e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46016/0 (socket says 172.21.15.46:46016) 2024-08-17T02:27:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f23e3e00640 1 -- 172.21.15.46:0/1708377054 learned_addr learned my addr 172.21.15.46:0/1708377054 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f899fe00640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a00ceb40 0x7f89a00cc590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f898c009850 tx=0x7f898c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f058c362e5a7ec4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f23db400640 1 --1- 172.21.15.46:0/1708377054 >> v1:172.21.15.46:6789/0 conn(0x7f23e406db70 0x7f23e415ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38722/0 (socket says 172.21.15.46:38722) 2024-08-17T02:27:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa98fe00640 1 -- 172.21.15.46:0/2562838023 learned_addr learned my addr 172.21.15.46:0/2562838023 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990165230 con 0x7fa99013b8b0 2024-08-17T02:27:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900ca5c0 con 0x7fa99013b110 2024-08-17T02:27:45.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f23e9000640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40af9a0 0x7f23e40acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99013be20 con 0x7fa99013b4e0 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa994e00640 1 -- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 msgr2=0x7fa990139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa994e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 0x7fa990139320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa994e00640 1 -- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 msgr2=0x7fa9900ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa994e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa9900ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7fa994e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98000dc50 con 0x7fa99013b8b0 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f899f400640 1 -- 172.21.15.46:0/1990017541 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c02ad90 con 0x7f89a00ceb40 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f899f400640 1 -- 172.21.15.46:0/1990017541 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c032440 con 0x7f89a00ceb40 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7f899f400640 1 -- 172.21.15.46:0/1990017541 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0327e0 con 0x7f89a00ceb40 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 shutdown_connections 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.717+0000 7ff93e000640 1 -- 172.21.15.46:0/98161618 wait complete. 2024-08-17T02:27:45.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576302708 0 0) 0x7f23e40ad640 con 0x7f23e406d7a0 2024-08-17T02:27:45.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c80034e0 con 0x7f23e406d7a0 2024-08-17T02:27:45.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260579820 0 0) 0x7f23e40ae250 con 0x7f23e406db70 2024-08-17T02:27:45.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e40ad640 con 0x7f23e406db70 2024-08-17T02:27:45.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.720+0000 7ff93e000640 1 Processor -- start 2024-08-17T02:27:45.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7fa994e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa988007c00 tx=0x7fa98800a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984555363 0 0) 0x7f23e40ad640 con 0x7f23e406db70 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40af9a0 msgr2=0x7f23e40acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40af9a0 0x7f23e40acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 >> v1:172.21.15.162:6789/0 conn(0x7f23e406d7a0 legacy=0x7f23e406e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40ad920 con 0x7f23e406db70 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f23cc0013f0 con 0x7f23e406db70 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 >> v1:172.21.15.46:6789/0 conn(0x7f23e406db70 legacy=0x7f23e415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8004bf0 0x7f23c8004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c8003720 0x7f23c8003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c80040d0 0x7f23c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c800bf60 con 0x7f23c80040d0 2024-08-17T02:27:45.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c800c0d0 con 0x7f23c8004bf0 2024-08-17T02:27:45.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800f070 con 0x7fa99013b8b0 2024-08-17T02:27:45.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c800c290 con 0x7f23c8003720 2024-08-17T02:27:45.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7f8df2800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0078f0 tx=0x7f8ddc037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800a2e0 con 0x7fa99013b8b0 2024-08-17T02:27:45.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.721+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800ca50 con 0x7fa99013b8b0 2024-08-17T02:27:45.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.722+0000 7f23e9000640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c80040d0 0x7f23c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.722+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99013c100 con 0x7fa99013b8b0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.722+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99013c6c0 con 0x7fa99013b8b0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.722+0000 7f23e3e00640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8004bf0 0x7f23c8004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.722+0000 7f23db400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c8003720 0x7f23c8003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0328e0 con 0x7f8dec13b4e0 2024-08-17T02:27:45.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc032a60 con 0x7f8dec13b4e0 2024-08-17T02:27:45.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc032e20 con 0x7f8dec13b4e0 2024-08-17T02:27:45.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f23db400640 1 -- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8004bf0 msgr2=0x7f23c8004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f23db400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8004bf0 0x7f23c8004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f23db400640 1 -- 172.21.15.46:0/1708377054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c80040d0 msgr2=0x7f23c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f23db400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23c80040d0 0x7f23c800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.723+0000 7f23db400640 1 -- 172.21.15.46:0/1708377054 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40ad920 con 0x7f23c8003720 2024-08-17T02:27:45.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.724+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec158cc0 con 0x7f8dec13b4e0 2024-08-17T02:27:45.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.724+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec13db40 con 0x7f8dec13b4e0 2024-08-17T02:27:45.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.724+0000 7fa984c00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9901653d0 con 0x7fa99013b8b0 2024-08-17T02:27:45.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.724+0000 7ff93e000640 1 -- start start 2024-08-17T02:27:45.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.725+0000 7f23db400640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c8003720 0x7f23c8003b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c190 tx=0x7f23cc001d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36923bb09afb9dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.725+0000 7f89a6600640 1 -- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a00ceb40 msgr2=0x7f89a00cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.725+0000 7f89a6600640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a00ceb40 0x7f89a00cc590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f898c009850 tx=0x7f898c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa988008440 con 0x7fa99013b8b0 2024-08-17T02:27:45.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 -- 172.21.15.46:0/1990017541 shutdown_connections 2024-08-17T02:27:45.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0070f0 con 0x7f23c8003720 2024-08-17T02:27:45.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc02d070 con 0x7f23c8003720 2024-08-17T02:27:45.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.725+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec158b20 con 0x7f8dec13b4e0 2024-08-17T02:27:45.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a0162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f23e3400640 1 -- 172.21.15.46:0/1708377054 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc0072b0 con 0x7f23c8003720 2024-08-17T02:27:45.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 --2- 172.21.15.46:0/1990017541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a00ceb40 0x7f89a00cc590 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f898c009850 tx=0x7f898c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 -- 172.21.15.46:0/1990017541 >> 172.21.15.46:0/1990017541 conn(0x7f89a0098e00 msgr2=0x7f89a006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7ff93e000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7ff93e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9300504b0 0x7ff9300361b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7ff93e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 -- 172.21.15.46:0/1990017541 shutdown_connections 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.726+0000 7f89a6600640 1 -- 172.21.15.46:0/1990017541 wait complete. 2024-08-17T02:27:45.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7fa987400640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 0x7fa970067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa988082130 con 0x7fa99013b8b0 2024-08-17T02:27:45.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7fa98fe00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 0x7fa970067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8ddc039050 con 0x7f8dec13b4e0 2024-08-17T02:27:45.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff937e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff937e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40680/0 (socket says 172.21.15.46:40680) 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff937400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff937400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42940/0 (socket says 172.21.15.46:42940) 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff936a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9300504b0 0x7ff9300361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7f23e9a00640 1 -- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c8003720 msgr2=0x7f23c8003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.727+0000 7f23e9a00640 1 --2- 172.21.15.46:0/1708377054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c8003720 0x7f23c8003b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00c190 tx=0x7f23cc001d80 comp rx=0 tx=0).stop 2024-08-17T02:27:45.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7f23e9000640 1 -- 172.21.15.46:0/1708377054 reap_dead start 2024-08-17T02:27:45.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff937e00640 1 -- 172.21.15.46:0/516406362 learned_addr learned my addr 172.21.15.46:0/516406362 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7f23e9a00640 1 -- 172.21.15.46:0/1708377054 shutdown_connections 2024-08-17T02:27:45.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7f23e9a00640 1 -- 172.21.15.46:0/1708377054 >> 172.21.15.46:0/1708377054 conn(0x7f23e4067750 msgr2=0x7f23e40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f23e9a00640 1 -- 172.21.15.46:0/1708377054 shutdown_connections 2024-08-17T02:27:45.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f89a6600640 1 Processor -- start 2024-08-17T02:27:45.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f8de5600640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 0x7f8dd00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f23e9a00640 1 -- 172.21.15.46:0/1708377054 wait complete. 2024-08-17T02:27:45.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ddc0a2c50 con 0x7f8dec13b4e0 2024-08-17T02:27:45.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.729+0000 7f89a6600640 1 -- start start 2024-08-17T02:27:45.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7fa98fe00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 0x7fa970067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa980005a20 tx=0x7fa98003a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7f8df1e00640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 0x7f8dd00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7f0106600640 1 Processor -- start 2024-08-17T02:27:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930101fb0 con 0x7ff9300d86d0 2024-08-17T02:27:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300feb60 con 0x7ff9300504b0 2024-08-17T02:27:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.728+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300dae90 con 0x7ff93004f1d0 2024-08-17T02:27:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 -- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 msgr2=0x7ff9300ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7f0106600640 1 -- start start 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 -- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9300504b0 msgr2=0x7ff9300361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9300504b0 0x7ff9300361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924009450 con 0x7ff9300d86d0 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937e00640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff93805ea30 tx=0x7ff9380ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.731+0000 7f8df1e00640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 0x7f8dd00676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8de8003e40 tx=0x7f8de8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.730+0000 7ff937400640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:45.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.731+0000 7f23e9a00640 1 Processor -- start 2024-08-17T02:27:45.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.731+0000 7f23e9a00640 1 -- start start 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.731+0000 7f89a6600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.731+0000 7f89a6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a0159ca0 0x7f89a00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a6600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89a00b4110 0x7f89a006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a6600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a014bed0 con 0x7f89a00b4110 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a014bbf0 con 0x7f89a0159ca0 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a6600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a006c120 con 0x7f89a00ccad0 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a5200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:42954/0 (socket says 172.21.15.46:42954) 2024-08-17T02:27:45.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a5200640 1 -- 172.21.15.46:0/4239684163 learned_addr learned my addr 172.21.15.46:0/4239684163 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f0106600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00f800db90 0x7f00f800df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f0106600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00f80518a0 0x7f00f80e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f0106600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f8052a00 con 0x7f00f8055a80 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f0106600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f8051df0 con 0x7f00f800db90 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f0106600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80520d0 con 0x7f00f80518a0 2024-08-17T02:27:45.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f899fe00640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a0159ca0 0x7f89a00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.732+0000 7f89a5c00640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89a00b4110 0x7f89a006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f89a5200640 1 -- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a0159ca0 msgr2=0x7f89a00b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f89a5200640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a0159ca0 0x7f89a00b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f89a5200640 1 -- 172.21.15.46:0/4239684163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89a00b4110 msgr2=0x7f89a006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f89a5200640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89a00b4110 0x7f89a006cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00f80518a0 0x7f00f80e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00f80518a0 0x7f00f80e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60608/0 (socket says 172.21.15.46:60608) 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 -- 172.21.15.46:0/4058038321 learned_addr learned my addr 172.21.15.46:0/4058038321 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105200640 1 --2- 172.21.15.46:0/4058038321 >> v2:172.21.15.46:3300/0 conn(0x7f00f800db90 0x7f00f800df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f89a5200640 1 -- 172.21.15.46:0/4239684163 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009390 con 0x7f89a00ccad0 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 0x7f23e4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7fc484e00640 1 Processor -- start 2024-08-17T02:27:45.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 0x7f23e40c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 -- 172.21.15.46:0/4058038321 >> v2:172.21.15.46:3300/0 conn(0x7f00f800db90 msgr2=0x7f00f800df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 --2- 172.21.15.46:0/4058038321 >> v2:172.21.15.46:3300/0 conn(0x7f00f800db90 0x7f00f800df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 -- 172.21.15.46:0/4058038321 >> v1:172.21.15.46:6789/0 conn(0x7f00f8055a80 legacy=0x7f00f80e5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41539e0 con 0x7f23e40c9f90 2024-08-17T02:27:45.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4152030 con 0x7f23c8003720 2024-08-17T02:27:45.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f23e9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4152dd0 con 0x7f23e40c8e10 2024-08-17T02:27:45.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7fc484e00640 1 -- start start 2024-08-17T02:27:45.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60616/0 (socket says 172.21.15.46:60616) 2024-08-17T02:27:45.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23e3e00640 1 -- 172.21.15.46:0/3832484676 learned_addr learned my addr 172.21.15.46:0/3832484676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23e9000640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 0x7f23e40c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8dec158b20 con 0x7f8dec13b4e0 2024-08-17T02:27:45.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f89a5200640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f899000c510 tx=0x7f899000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23e9000640 1 -- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 msgr2=0x7f23e4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.734+0000 7f23db400640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 0x7f23e4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23e9000640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23e9000640 1 -- 172.21.15.46:0/3832484676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 msgr2=0x7f23e4152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23e9000640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 0x7f23e4152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23e9000640 1 -- 172.21.15.46:0/3832484676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e41530b0 con 0x7f23e40c8e10 2024-08-17T02:27:45.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.733+0000 7f0105c00640 1 -- 172.21.15.46:0/4058038321 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80523b0 con 0x7f00f80518a0 2024-08-17T02:27:45.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23db400640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 0x7f23e4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:45.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f23e3e00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:45.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93806fba0 con 0x7ff9300d86d0 2024-08-17T02:27:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990005aa0 con 0x7f89a00ccad0 2024-08-17T02:27:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990005c00 con 0x7f89a00ccad0 2024-08-17T02:27:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900070d0 con 0x7f89a00ccad0 2024-08-17T02:27:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f0105c00640 1 --2- 172.21.15.46:0/4058038321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f80518a0 0x7f00f80e65a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00f8051390 tx=0x7f00ec0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e7d10640fad094 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f3506e00640 1 Processor -- start 2024-08-17T02:27:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff938065e30 con 0x7ff9300d86d0 2024-08-17T02:27:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9300db450 con 0x7ff9300d86d0 2024-08-17T02:27:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93804b480 con 0x7ff9300d86d0 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.735+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a006c400 con 0x7f89a00ccad0 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc484e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4800c6a30 0x7fc4800cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc484e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 0x7fc4800c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc484e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800cbf40 con 0x7fc480159060 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc484e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800cb930 con 0x7fc4800c6a30 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc484e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ced10 con 0x7fc480159430 2024-08-17T02:27:45.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93806fba0 con 0x7ff9300d86d0 2024-08-17T02:27:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a006d120 con 0x7f89a00ccad0 2024-08-17T02:27:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc47de00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc480159060 0x7fc4800cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38740/0 (socket says 172.21.15.46:38740) 2024-08-17T02:27:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9901653d0 con 0x7fa99013b8b0 2024-08-17T02:27:45.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc47de00640 1 -- 172.21.15.46:0/732472307 learned_addr learned my addr 172.21.15.46:0/732472307 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7fc47e800640 1 --2- 172.21.15.46:0/732472307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 0x7fc4800c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.736+0000 7f3506e00640 1 -- start start 2024-08-17T02:27:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300fed20 con 0x7ff9300d86d0 2024-08-17T02:27:45.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7fc47d400640 1 --2- 172.21.15.46:0/732472307 >> v2:172.21.15.162:3300/0 conn(0x7fc4800c6a30 0x7fc4800cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7f00ff400640 1 -- 172.21.15.46:0/4058038321 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec02aea0 con 0x7f00f80518a0 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7f3506e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3500158c80 0x7f35000ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3506e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35000cc9d0 0x7f35000acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3506e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000cf9d0 con 0x7f35000cd700 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3506e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000ceb60 con 0x7f3500158c80 2024-08-17T02:27:45.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3506e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000cedc0 con 0x7f35000cc9d0 2024-08-17T02:27:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3505000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f35000cd700 0x7f35000cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46022/0 (socket says 172.21.15.46:46022) 2024-08-17T02:27:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3505000640 1 -- 172.21.15.46:0/3098584371 learned_addr learned my addr 172.21.15.46:0/3098584371 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f23e9000640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 0x7f23e40c92b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23e4065fd0 tx=0x7f23dc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f3505a00640 1 --2- 172.21.15.46:0/3098584371 >> v2:172.21.15.46:3300/0 conn(0x7f3500158c80 0x7f35000ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f00ff400640 1 -- 172.21.15.46:0/4058038321 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec032440 con 0x7f00f80518a0 2024-08-17T02:27:45.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.738+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00e040 con 0x7f23e40c8e10 2024-08-17T02:27:45.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc00f040 con 0x7f23e40c8e10 2024-08-17T02:27:45.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc015920 con 0x7f23e40c8e10 2024-08-17T02:27:45.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e4153390 con 0x7f23e40c8e10 2024-08-17T02:27:45.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f3506400640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35000cc9d0 0x7f35000acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7fc47e800640 1 -- 172.21.15.46:0/732472307 >> v2:172.21.15.162:3300/0 conn(0x7fc4800c6a30 msgr2=0x7fc4800cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7fc47e800640 1 --2- 172.21.15.46:0/732472307 >> v2:172.21.15.162:3300/0 conn(0x7fc4800c6a30 0x7fc4800cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7fc47e800640 1 -- 172.21.15.46:0/732472307 >> v1:172.21.15.46:6789/0 conn(0x7fc480159060 legacy=0x7fc4800cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.737+0000 7fc47e800640 1 -- 172.21.15.46:0/732472307 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800cbbd0 con 0x7fc480159430 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f0106600640 1 -- 172.21.15.46:0/4058038321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f80518a0 msgr2=0x7f00f80e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f00ff400640 1 -- 172.21.15.46:0/4058038321 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec032820 con 0x7f00f80518a0 2024-08-17T02:27:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f0106600640 1 --2- 172.21.15.46:0/4058038321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f80518a0 0x7f00f80e65a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00f8051390 tx=0x7f00ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7fc47e800640 1 --2- 172.21.15.46:0/732472307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 0x7fc4800c6e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc470009850 tx=0x7fc4700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b3d1df245fe2d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.739+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e40c97f0 con 0x7f23e40c8e10 2024-08-17T02:27:45.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a006c880 con 0x7f89a00ccad0 2024-08-17T02:27:45.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7fc47ca00640 1 -- 172.21.15.46:0/732472307 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47002ad00 con 0x7fc480159430 2024-08-17T02:27:45.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7fc47ca00640 1 -- 172.21.15.46:0/732472307 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47002ae60 con 0x7fc480159430 2024-08-17T02:27:45.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915094293 0 0) 0x7f35000cf9d0 con 0x7f35000cd700 2024-08-17T02:27:45.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e80034e0 con 0x7f35000cd700 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291281907 0 0) 0x7f34e80034e0 con 0x7f35000cd700 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35000cc9d0 msgr2=0x7f35000acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35000cc9d0 0x7f35000acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 >> v2:172.21.15.46:3300/0 conn(0x7f3500158c80 msgr2=0x7f35000ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 --2- 172.21.15.46:0/3098584371 >> v2:172.21.15.46:3300/0 conn(0x7f3500158c80 0x7f35000ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000cf0a0 con 0x7f35000cd700 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f34f4001450 con 0x7f35000cd700 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.740+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 >> v1:172.21.15.162:6789/0 conn(0x7f35000cd700 legacy=0x7f35000cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e8003a50 0x7f34e8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8004780 0x7f34e8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e8005130 0x7f34e80079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000ceb60 con 0x7f34e8005130 2024-08-17T02:27:45.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000cedc0 con 0x7f34e8003a50 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8008080 con 0x7f34e8004780 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f3505a00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e8003a50 0x7f34e8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f3505000640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8004780 0x7f34e8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7fc47ca00640 1 -- 172.21.15.46:0/732472307 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470032670 con 0x7fc480159430 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff938069000 con 0x7ff9300d86d0 2024-08-17T02:27:45.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e4153810 con 0x7f23e40c8e10 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 -- 172.21.15.46:0/732472307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 msgr2=0x7fc4800c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 --2- 172.21.15.46:0/732472307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 0x7fc4800c6e90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc470009850 tx=0x7fc4700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f0106600640 1 -- 172.21.15.46:0/4058038321 shutdown_connections 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f0106600640 1 --2- 172.21.15.46:0/4058038321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f80518a0 0x7f00f80e65a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f0106600640 1 --2- 172.21.15.46:0/4058038321 >> v2:172.21.15.46:3300/0 conn(0x7f00f800db90 0x7f00f800df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f0106600640 1 -- 172.21.15.46:0/4058038321 >> 172.21.15.46:0/4058038321 conn(0x7f00f800a7d0 msgr2=0x7f00f8056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.741+0000 7f3506400640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e8005130 0x7f34e80079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.742+0000 7f3506400640 1 -- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8004780 msgr2=0x7f34e8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.742+0000 7f3506400640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8004780 0x7f34e8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.742+0000 7f3506400640 1 -- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e8003a50 msgr2=0x7f34e8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.742+0000 7f3506400640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e8003a50 0x7f34e8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.742+0000 7f3506400640 1 -- 172.21.15.46:0/3098584371 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80034e0 con 0x7f34e8005130 2024-08-17T02:27:45.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f23dc015d50 con 0x7f23e40c8e10 2024-08-17T02:27:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7ff92aa00640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 0x7ff9180676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 -- 172.21.15.46:0/732472307 shutdown_connections 2024-08-17T02:27:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 --2- 172.21.15.46:0/732472307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc480159430 0x7fc4800c6e90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8990007500 con 0x7f89a00ccad0 2024-08-17T02:27:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 --2- 172.21.15.46:0/732472307 >> v2:172.21.15.162:3300/0 conn(0x7fc4800c6a30 0x7fc4800cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.743+0000 7fc484e00640 1 -- 172.21.15.46:0/732472307 >> 172.21.15.46:0/732472307 conn(0x7fc4800cfde0 msgr2=0x7fc4800d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.744+0000 7f0106600640 1 -- 172.21.15.46:0/4058038321 shutdown_connections 2024-08-17T02:27:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.744+0000 7f23dbe00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 0x7f23c0067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23dc082390 con 0x7f23e40c8e10 2024-08-17T02:27:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7fc484e00640 1 -- 172.21.15.46:0/732472307 shutdown_connections 2024-08-17T02:27:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.744+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff938119060 con 0x7ff9300d86d0 2024-08-17T02:27:45.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7fc484e00640 1 -- 172.21.15.46:0/732472307 wait complete. 2024-08-17T02:27:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7f8997e00640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 0x7f89800676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89900818a0 con 0x7f89a00ccad0 2024-08-17T02:27:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.744+0000 7f3506400640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e8005130 0x7f34e80079b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009f40 tx=0x7f34f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c06825f6eca291 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7ff937400640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 0x7ff9180676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7f23e3e00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 0x7f23c0067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.745+0000 7f899fe00640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 0x7f89800676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.744+0000 7f0106600640 1 -- 172.21.15.46:0/4058038321 wait complete. 2024-08-17T02:27:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.746+0000 7f0106600640 1 Processor -- start 2024-08-17T02:27:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.746+0000 7f23e3e00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 0x7f23c0067780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23d40010e0 tx=0x7f23d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.746+0000 7f899fe00640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 0x7f89800676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f898c034000 tx=0x7f898c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7fc484e00640 1 Processor -- start 2024-08-17T02:27:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7f0106600640 1 -- start start 2024-08-17T02:27:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8007410 con 0x7f34e8005130 2024-08-17T02:27:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f802d050 con 0x7f34e8005130 2024-08-17T02:27:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7f34ffe00640 1 -- 172.21.15.46:0/3098584371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80077c0 con 0x7f34e8005130 2024-08-17T02:27:45.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7fc484e00640 1 -- start start 2024-08-17T02:27:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.747+0000 7ff937400640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 0x7ff9180676c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff93004b7a0 tx=0x7ff92c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 0x7fc48015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 0x7fc4800b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 0x7fc48014ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4801717b0 con 0x7fc480159430 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480158730 con 0x7fc480159060 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7fc484e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc480170e80 con 0x7fc4800c6a30 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 0x7f00f80cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 0x7f00f80e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f8055a80 0x7f00f80e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80dbb20 con 0x7f00f80518a0 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80dbe00 con 0x7f00f800db90 2024-08-17T02:27:45.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f0106600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80dc0e0 con 0x7f00f8055a80 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f3506e00640 1 -- 172.21.15.46:0/3098584371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e8005130 msgr2=0x7f34e80079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f3506e00640 1 --2- 172.21.15.46:0/3098584371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e8005130 0x7f34e80079b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009f40 tx=0x7f34f800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7f3506400640 1 -- 172.21.15.46:0/3098584371 reap_dead start 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.748+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9380eabb0 con 0x7ff9300d86d0 2024-08-17T02:27:45.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23dc050430 con 0x7f23e40c8e10 2024-08-17T02:27:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7fc47de00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 0x7fc48015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7fc47d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 0x7fc4800b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f3506e00640 1 -- 172.21.15.46:0/3098584371 shutdown_connections 2024-08-17T02:27:45.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f3506e00640 1 -- 172.21.15.46:0/3098584371 >> 172.21.15.46:0/3098584371 conn(0x7f3500098e30 msgr2=0x7f350006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f0105200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 0x7f00f80cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f0105200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 0x7f00f80cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60648/0 (socket says 172.21.15.46:60648) 2024-08-17T02:27:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f0105200640 1 -- 172.21.15.46:0/3618331365 learned_addr learned my addr 172.21.15.46:0/3618331365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f0105c00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f8055a80 0x7f00f80e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7fc47d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 0x7fc4800b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60646/0 (socket says 172.21.15.46:60646) 2024-08-17T02:27:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7fc47d400640 1 -- 172.21.15.46:0/420035903 learned_addr learned my addr 172.21.15.46:0/420035903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f3506e00640 1 -- 172.21.15.46:0/3098584371 shutdown_connections 2024-08-17T02:27:45.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f00ffe00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 0x7f00f80e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7fc47e800640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 0x7fc48014ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 -- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 msgr2=0x7fc48015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 0x7fc48015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 -- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 msgr2=0x7fc4800b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 0x7fc4800b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 -- 172.21.15.46:0/420035903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009390 con 0x7fc480159430 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47de00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 0x7fc48015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:45.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7f00ffe00640 1 -- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f8055a80 msgr2=0x7f00f80e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.750+0000 7fc47e800640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 0x7fc48014ca50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc470031000 tx=0x7fc470032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7f00ffe00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f8055a80 0x7f00f80e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7f00ffe00640 1 -- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 msgr2=0x7f00f80cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7f00ffe00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 0x7f00f80cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7f00ffe00640 1 -- 172.21.15.46:0/3618331365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009450 con 0x7f00f80518a0 2024-08-17T02:27:45.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470031a60 con 0x7fc480159430 2024-08-17T02:27:45.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470031c00 con 0x7fc480159430 2024-08-17T02:27:45.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480171160 con 0x7fc480159430 2024-08-17T02:27:45.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48015b610 con 0x7fc480159430 2024-08-17T02:27:45.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47003c410 con 0x7fc480159430 2024-08-17T02:27:45.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.749+0000 7f3506e00640 1 -- 172.21.15.46:0/3098584371 wait complete. 2024-08-17T02:27:45.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.751+0000 7f3506e00640 1 Processor -- start 2024-08-17T02:27:45.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.752+0000 7f3506e00640 1 -- start start 2024-08-17T02:27:45.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.752+0000 7f00ffe00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 0x7f00f80e05b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00f8055e50 tx=0x7f00f4007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f899004fa90 con 0x7f89a00ccad0 2024-08-17T02:27:45.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4011590 con 0x7f00f80518a0 2024-08-17T02:27:45.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f40116f0 con 0x7f00f80518a0 2024-08-17T02:27:45.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4011ab0 con 0x7f00f80518a0 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f3506e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8005130 0x7f3500158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f3506e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35000b0e20 0x7f3500155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f3506e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.754+0000 7f3505000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35000b0e20 0x7f3500155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.754+0000 7f3506e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35000c49f0 con 0x7f3500164e60 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.754+0000 7f3506e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3500165810 con 0x7f35000b0e20 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.754+0000 7f3506e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3500165cb0 con 0x7f34e8005130 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80e1740 con 0x7f00f80518a0 2024-08-17T02:27:45.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.753+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f80cd630 con 0x7f00f80518a0 2024-08-17T02:27:45.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.755+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc458005210 con 0x7fc480159430 2024-08-17T02:27:45.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.755+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f8005320 con 0x7f00f80518a0 2024-08-17T02:27:45.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.755+0000 7f3506400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.755+0000 7f3506400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40766/0 (socket says 172.21.15.46:40766) 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.755+0000 7f3506400640 1 -- 172.21.15.46:0/1521947690 learned_addr learned my addr 172.21.15.46:0/1521947690 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 -- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8005130 msgr2=0x7f3500158420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8005130 0x7f3500158420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 -- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35000b0e20 msgr2=0x7f3500155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35000b0e20 0x7f3500155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 -- 172.21.15.46:0/1521947690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35000b1380 con 0x7f3500164e60 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.756+0000 7f3506400640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34f802aa10 tx=0x7f34f8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f803c630 con 0x7f3500164e60 2024-08-17T02:27:45.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc470039050 con 0x7fc480159430 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.760+0000 7fc475600640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 0x7fc460067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.760+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4700a2f50 con 0x7fc480159430 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00f401b3b0 con 0x7f00f80518a0 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.760+0000 7f00f3e00640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 0x7f00e00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000b1660 con 0x7f3500164e60 2024-08-17T02:27:45.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35000c4680 con 0x7f3500164e60 2024-08-17T02:27:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.758+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f800f040 con 0x7f3500164e60 2024-08-17T02:27:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.760+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f803c630 con 0x7f3500164e60 2024-08-17T02:27:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.760+0000 7fc47de00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 0x7fc460067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.761+0000 7f0105200640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 0x7f00e00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.761+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00f4081790 con 0x7f00f80518a0 2024-08-17T02:27:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.762+0000 7f0105200640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 0x7f00e00676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0100076770 tx=0x7f0100069040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.762+0000 7fc47de00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 0x7fc460067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc478007210 tx=0x7fc478000f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.763+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc005210 con 0x7f3500164e60 2024-08-17T02:27:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.766+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc470071020 con 0x7fc480159430 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.768+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f34f803c9e0 con 0x7f3500164e60 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.769+0000 7f34fcc00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 0x7f34e0067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.770+0000 7f3505a00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 0x7f34e0067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.771+0000 7f3505a00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 0x7f34e0067690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00b240 tx=0x7f34ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.774+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34f8075670 con 0x7f3500164e60 2024-08-17T02:27:45.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.777+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f00f4017020 con 0x7f00f80518a0 2024-08-17T02:27:45.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:45.784+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f34f80712b0 con 0x7f3500164e60 2024-08-17T02:27:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.155+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89a0071050 con 0x7f89a00ccad0 2024-08-17T02:27:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.156+0000 7f8997e00640 1 -- 172.21.15.46:0/4239684163 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8990017020 con 0x7f89a00ccad0 2024-08-17T02:27:46.157 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2024-08-17T02:27:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.159+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 msgr2=0x7f89800676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.159+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 0x7f89800676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f898c034000 tx=0x7f898c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.159+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 msgr2=0x7f89a006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.159+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f899000c510 tx=0x7f899000c910 comp rx=0 tx=0).stop 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 shutdown_connections 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89a00b4110 0x7f89a006cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a0159ca0 0x7f89a00b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8980065220 0x7f89800676d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 --2- 172.21.15.46:0/4239684163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a00ccad0 0x7f89a006db20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.160+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 >> 172.21.15.46:0/4239684163 conn(0x7f89a0098e00 msgr2=0x7f89a00cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.161+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 shutdown_connections 2024-08-17T02:27:46.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.161+0000 7f89a6600640 1 -- 172.21.15.46:0/4239684163 wait complete. 2024-08-17T02:27:46.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.161+0000 7fa984c00640 1 -- 172.21.15.46:0/2562838023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa9901653d0 con 0x7fa99013b8b0 2024-08-17T02:27:46.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.162+0000 7fa987400640 1 -- 172.21.15.46:0/2562838023 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9901653d0 con 0x7fa99013b8b0 2024-08-17T02:27:46.166 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:46.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.166+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8dec158b20 con 0x7f8dec13b4e0 2024-08-17T02:27:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.166+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 msgr2=0x7fa970067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.166+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 0x7fa970067700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa980005a20 tx=0x7fa98003a000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.166+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 msgr2=0x7fa990139c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.166+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa988007c00 tx=0x7fa98800a520 comp rx=0 tx=0).stop 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 shutdown_connections 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa99013b8b0 0x7fa990139c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa970065250 0x7fa970067700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa99013b4e0 0x7fa990139320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 --2- 172.21.15.46:0/2562838023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa99013b110 0x7fa9900ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 >> 172.21.15.46:0/2562838023 conn(0x7fa9900cb7a0 msgr2=0x7fa990157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7f8de5600640 1 -- 172.21.15.46:0/3049370293 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ddc040020 con 0x7f8dec13b4e0 2024-08-17T02:27:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 shutdown_connections 2024-08-17T02:27:46.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.167+0000 7fa996e00640 1 -- 172.21.15.46:0/2562838023 wait complete. 2024-08-17T02:27:46.169 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2024-08-17T02:27:46.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 msgr2=0x7f8dd00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f23e4071050 con 0x7f23e40c8e10 2024-08-17T02:27:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 0x7f8dd00676d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8de8003e40 tx=0x7f8de8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 msgr2=0x7f8dec13a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0078f0 tx=0x7f8ddc037000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 shutdown_connections 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8dd0065220 0x7f8dd00676d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8dec13b4e0 0x7f8dec13a040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dec13b110 0x7f8dec139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 --2- 172.21.15.46:0/3049370293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dec0aedc0 0x7f8dec13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 >> 172.21.15.46:0/3049370293 conn(0x7f8dec0cb7a0 msgr2=0x7f8dec06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.170+0000 7f23dbe00640 1 -- 172.21.15.46:0/3832484676 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23dc053a50 con 0x7f23e40c8e10 2024-08-17T02:27:46.172 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2024-08-17T02:27:46.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.174+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 shutdown_connections 2024-08-17T02:27:46.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.175+0000 7f8df4800640 1 -- 172.21.15.46:0/3049370293 wait complete. 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 msgr2=0x7f23c0067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 0x7f23c0067780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23d40010e0 tx=0x7f23d4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 msgr2=0x7f23e40c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 0x7f23e40c92b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f23e4065fd0 tx=0x7f23dc00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 shutdown_connections 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f23c00652d0 0x7f23c0067780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e40c8e10 0x7f23e40c92b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23e40c9f90 0x7f23e4152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 --2- 172.21.15.46:0/3832484676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c8003720 0x7f23e4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 >> 172.21.15.46:0/3832484676 conn(0x7f23e4067750 msgr2=0x7f23e4157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.176+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 shutdown_connections 2024-08-17T02:27:46.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.177+0000 7f23e9a00640 1 -- 172.21.15.46:0/3832484676 wait complete. 2024-08-17T02:27:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.180+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff930005320 con 0x7ff9300d86d0 2024-08-17T02:27:46.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.185+0000 7ff92aa00640 1 -- 172.21.15.46:0/516406362 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9380ea740 con 0x7ff9300d86d0 2024-08-17T02:27:46.189 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2024-08-17T02:27:46.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-08-17T02:27:46.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 msgr2=0x7ff9180676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4580054c0 con 0x7fc480159430 2024-08-17T02:27:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 0x7ff9180676c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff93004b7a0 tx=0x7ff92c009040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 msgr2=0x7ff930036ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff93805ea30 tx=0x7ff9380ab000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 shutdown_connections 2024-08-17T02:27:46.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9300d86d0 0x7ff930036ca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9300504b0 0x7ff9300361b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.190+0000 7fc475600640 1 -- 172.21.15.46:0/420035903 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc470037090 con 0x7fc480159430 2024-08-17T02:27:46.192 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff918065210 0x7ff9180676c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 --2- 172.21.15.46:0/516406362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93004f1d0 0x7ff9300ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 >> 172.21.15.46:0/516406362 conn(0x7ff930051600 msgr2=0x7ff930006f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 shutdown_connections 2024-08-17T02:27:46.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.189+0000 7ff93e000640 1 -- 172.21.15.46:0/516406362 wait complete. 2024-08-17T02:27:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 msgr2=0x7fc460067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 0x7fc460067600 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc478007210 tx=0x7fc478000f40 comp rx=0 tx=0).stop 2024-08-17T02:27:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 msgr2=0x7fc48014ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 0x7fc48014ca50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc470031000 tx=0x7fc470032000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 shutdown_connections 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc480159430 0x7fc48014ca50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc480159060 0x7fc4800b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc460065150 0x7fc460067600 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 --2- 172.21.15.46:0/420035903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4800c6a30 0x7fc48015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 >> 172.21.15.46:0/420035903 conn(0x7fc4800cfde0 msgr2=0x7fc480068190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 shutdown_connections 2024-08-17T02:27:46.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.193+0000 7fc484e00640 1 -- 172.21.15.46:0/420035903 wait complete. 2024-08-17T02:27:46.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-08-17T02:27:46.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-08-17T02:27:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.200+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f00f8009630 con 0x7f00f80518a0 2024-08-17T02:27:46.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.200+0000 7f00f3e00640 1 -- 172.21.15.46:0/3618331365 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00f404f980 con 0x7f00f80518a0 2024-08-17T02:27:46.201 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.202+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f34dc005790 con 0x7f3500164e60 2024-08-17T02:27:46.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.202+0000 7f34fcc00640 1 -- 172.21.15.46:0/1521947690 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34f80748d0 con 0x7f3500164e60 2024-08-17T02:27:46.203 INFO:teuthology.orchestra.run.smithi046.stdout:55834574852 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 msgr2=0x7f00e00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 0x7f00e00676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0100076770 tx=0x7f0100069040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 msgr2=0x7f00f80e05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 0x7f00f80e05b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00f8055e50 tx=0x7f00f4007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 shutdown_connections 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f00e0065220 0x7f00e00676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f8055a80 0x7f00f80e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00f80518a0 0x7f00f80e05b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 --2- 172.21.15.46:0/3618331365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f800db90 0x7f00f80cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 >> 172.21.15.46:0/3618331365 conn(0x7f00f800a7d0 msgr2=0x7f00f804d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 shutdown_connections 2024-08-17T02:27:46.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:27:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.203+0000 7f0106600640 1 -- 172.21.15.46:0/3618331365 wait complete. 2024-08-17T02:27:46.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 msgr2=0x7f34e0067690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 0x7f34e0067690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00b240 tx=0x7f34ec008040 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 msgr2=0x7f35001652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34f802aa10 tx=0x7f34f8035000 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 shutdown_connections 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3500164e60 0x7f35001652d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35000b0e20 0x7f3500155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f34e00651e0 0x7f34e0067690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 --2- 172.21.15.46:0/1521947690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e8005130 0x7f3500158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 >> 172.21.15.46:0/1521947690 conn(0x7f3500098e30 msgr2=0x7f35000ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 shutdown_connections 2024-08-17T02:27:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:46.205+0000 7f3506e00640 1 -- 172.21.15.46:0/1521947690 wait complete. 2024-08-17T02:27:46.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-08-17T02:27:46.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-08-17T02:27:46.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-08-17T02:27:46.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-08-17T02:27:47.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:47.196 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:47.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:47.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:47.214 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:47.215 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:47.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:47.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:47.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.426+0000 7fc9c8e00640 1 Processor -- start 2024-08-17T02:27:47.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.427+0000 7fc9c8e00640 1 -- start start 2024-08-17T02:27:47.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.430+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 0x7fc9bc005e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.430+0000 7fc9c1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc9bc0d86d0 0x7fc9bc04fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46030/0 (socket says 172.21.15.46:46030) 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.430+0000 7fc9c1e00640 1 -- 172.21.15.46:0/869738235 learned_addr learned my addr 172.21.15.46:0/869738235 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.430+0000 7fc9c1400640 1 --2- 172.21.15.46:0/869738235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 0x7fc9bc005e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.431+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc053840 con 0x7fc9bc04f1d0 2024-08-17T02:27:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.431+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9bc053380 con 0x7fc9bc0d86d0 2024-08-17T02:27:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.431+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0df740 con 0x7fc9bc0504b0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.431+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882848646 0 0) 0x7fc9bc053380 con 0x7fc9bc0d86d0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.432+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a80034c0 con 0x7fc9bc0d86d0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.433+0000 7fc9c1400640 1 -- 172.21.15.46:0/869738235 >> v1:172.21.15.162:6789/0 conn(0x7fc9bc0d86d0 legacy=0x7fc9bc04fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.433+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860359172 0 0) 0x7fc9bc053840 con 0x7fc9bc04f1d0 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.433+0000 7fc9c1400640 1 -- 172.21.15.46:0/869738235 >> v1:172.21.15.46:6789/0 conn(0x7fc9bc04f1d0 legacy=0x7fc9bc053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.433+0000 7fc9c1400640 1 -- 172.21.15.46:0/869738235 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc0deea0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.436+0000 7fc9c1400640 1 --2- 172.21.15.46:0/869738235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 0x7fc9bc005e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0008310 tx=0x7fc9b000c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f73012c70da8b76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.437+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00089e0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.437+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0008b40 con 0x7fc9bc0504b0 2024-08-17T02:27:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.438+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 msgr2=0x7fc9bc005e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.438+0000 7fc9c0a00640 1 -- 172.21.15.46:0/869738235 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00089e0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.438+0000 7fc9c8e00640 1 --2- 172.21.15.46:0/869738235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 0x7fc9bc005e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0008310 tx=0x7fc9b000c040 comp rx=0 tx=0).stop 2024-08-17T02:27:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.439+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 shutdown_connections 2024-08-17T02:27:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.439+0000 7fc9c8e00640 1 --2- 172.21.15.46:0/869738235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc0504b0 0x7fc9bc005e20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.439+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 >> 172.21.15.46:0/869738235 conn(0x7fc9bc051600 msgr2=0x7fc9bc051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.440+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 shutdown_connections 2024-08-17T02:27:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.440+0000 7fc9c8e00640 1 -- 172.21.15.46:0/869738235 wait complete. 2024-08-17T02:27:47.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.443+0000 7fc9c8e00640 1 Processor -- start 2024-08-17T02:27:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.443+0000 7fc9c8e00640 1 -- start start 2024-08-17T02:27:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.446+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.446+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.447+0000 7fc9c1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.447+0000 7fc9c1e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:43036/0 (socket says 172.21.15.46:43036) 2024-08-17T02:27:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.447+0000 7fc9c1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.447+0000 7fc9c1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40770/0 (socket says 172.21.15.46:40770) 2024-08-17T02:27:47.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.447+0000 7fc9c1e00640 1 -- 172.21.15.46:0/3182713852 learned_addr learned my addr 172.21.15.46:0/3182713852 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.448+0000 7fc9c8e00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9bc0d86d0 0x7fc9bc039420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.448+0000 7fc9c8e00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc038f90 con 0x7fc9bc0504b0 2024-08-17T02:27:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.448+0000 7fc9c2800640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9bc0d86d0 0x7fc9bc039420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.448+0000 7fc9c8e00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc04c470 con 0x7fc9bc0d86d0 2024-08-17T02:27:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.448+0000 7fc9c8e00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc04c750 con 0x7fc9bc04f1d0 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1400640 1 -- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 msgr2=0x7fc9bc04bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1400640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1400640 1 -- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9bc0d86d0 msgr2=0x7fc9bc039420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1400640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9bc0d86d0 0x7fc9bc039420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1400640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b000adc0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.450+0000 7fc9c1e00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:47.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.451+0000 7fc9c1400640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0039000 tx=0x7fc9b003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.452+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00089e0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.452+0000 7fc9c8e00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc038c20 con 0x7fc9bc0504b0 2024-08-17T02:27:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.452+0000 7fc9c8e00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc0d5b80 con 0x7fc9bc0504b0 2024-08-17T02:27:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.452+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0041a50 con 0x7fc9bc0504b0 2024-08-17T02:27:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.452+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0041e70 con 0x7fc9bc0504b0 2024-08-17T02:27:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.456+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc998005210 con 0x7fc9bc0504b0 2024-08-17T02:27:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.462+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc9b0037620 con 0x7fc9bc0504b0 2024-08-17T02:27:47.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.463+0000 7fc9b9600640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 0x7fc9a4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.463+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9b00ab620 con 0x7fc9bc0504b0 2024-08-17T02:27:47.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.470+0000 7fc9c1e00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 0x7fc9a4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.470+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc9b0079770 con 0x7fc9bc0504b0 2024-08-17T02:27:47.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.471+0000 7fc9c1e00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 0x7fc9a4067680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40018f0 tx=0x7fc9b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.507+0000 7fc235600640 1 Processor -- start 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.507+0000 7fc235600640 1 -- start start 2024-08-17T02:27:47.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7fc235600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2280e0130 0x7fc228051bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7f1adcc00640 1 Processor -- start 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7f1adcc00640 1 -- start start 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7fc235600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc228054970 con 0x7fc228057540 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7fc235600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2280361c0 con 0x7fc2280dfd60 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.509+0000 7fc235600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc228035fd0 con 0x7fc2280e0130 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.510+0000 7fc22fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc2280dfd60 0x7fc2280358c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46034/0 (socket says 172.21.15.46:46034) 2024-08-17T02:27:47.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.510+0000 7fc22fe00640 1 -- 172.21.15.46:0/1857190184 learned_addr learned my addr 172.21.15.46:0/1857190184 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.510+0000 7fc22f400640 1 --2- 172.21.15.46:0/1857190184 >> v2:172.21.15.162:3300/0 conn(0x7fc2280e0130 0x7fc228051bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.510+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305917416 0 0) 0x7fc2280361c0 con 0x7fc2280dfd60 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.510+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2180034e0 con 0x7fc2280dfd60 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553620827 0 0) 0x7fc2180034e0 con 0x7fc2280dfd60 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 >> v2:172.21.15.162:3300/0 conn(0x7fc2280e0130 msgr2=0x7fc228051bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 --2- 172.21.15.46:0/1857190184 >> v2:172.21.15.162:3300/0 conn(0x7fc2280e0130 0x7fc228051bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 >> v1:172.21.15.46:6789/0 conn(0x7fc228057540 legacy=0x7fc2280553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280364a0 con 0x7fc2280dfd60 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7fc220001470 con 0x7fc2280dfd60 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 >> v1:172.21.15.162:6789/0 conn(0x7fc2280dfd60 legacy=0x7fc2280358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 0x7fc218003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218004780 0x7fc218004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc218005130 0x7fc2180145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218014b10 con 0x7fc218004780 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218014c50 con 0x7fc218003a50 2024-08-17T02:27:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc218014d90 con 0x7fc218005130 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7f1adcc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ad00e7600 0x7f1ad0038700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7f1adcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad0038c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7f1adcc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad003afe0 con 0x7f1ad00e6220 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7f1adcc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad003ade0 con 0x7f1ad00e7600 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.511+0000 7f1adcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad003b2c0 con 0x7f1ad00eac50 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7fc22fe00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 0x7fc218003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7fc22f400640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218004780 0x7fc218004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7fc234c00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc218005130 0x7fc2180145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7f1ad7400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1ad00e6220 0x7f1ad003a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38768/0 (socket says 172.21.15.46:38768) 2024-08-17T02:27:47.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7f1ad7400640 1 -- 172.21.15.46:0/3236463144 learned_addr learned my addr 172.21.15.46:0/3236463144 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:47.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.512+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/3236463144 >> v2:172.21.15.162:3300/0 conn(0x7f1ad00e7600 0x7f1ad0038700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7f1ad7e00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad0038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7fc22fe00640 1 -- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc218005130 msgr2=0x7fc2180145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7fc22fe00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc218005130 0x7fc2180145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7fc22fe00640 1 -- 172.21.15.46:0/1857190184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218004780 msgr2=0x7fc218004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7fc22fe00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218004780 0x7fc218004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7f1ad6a00640 1 -- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 msgr2=0x7f1ad0038c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad0038c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7f1ad6a00640 1 -- 172.21.15.46:0/3236463144 >> v1:172.21.15.46:6789/0 conn(0x7f1ad00e6220 legacy=0x7f1ad003a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.513+0000 7f1ad6a00640 1 -- 172.21.15.46:0/3236463144 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad003b5a0 con 0x7f1ad00e7600 2024-08-17T02:27:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.514+0000 7fc234c00640 1 -- 172.21.15.46:0/1857190184 reap_dead start 2024-08-17T02:27:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.515+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0038700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009850 tx=0x7f1acc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b433aad9875f7567 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.514+0000 7fc22fe00640 1 -- 172.21.15.46:0/1857190184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280364a0 con 0x7fc218003a50 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.515+0000 7f1ad6000640 1 -- 172.21.15.46:0/3236463144 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc02ad20 con 0x7f1ad00e7600 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.516+0000 7f1ad6000640 1 -- 172.21.15.46:0/3236463144 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc02ae80 con 0x7f1ad00e7600 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.516+0000 7f1ad6000640 1 -- 172.21.15.46:0/3236463144 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc032670 con 0x7f1ad00e7600 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7fc22fe00640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 0x7fc218003e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc220001ed0 tx=0x7fc220001e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3997611f1e1f5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22002e070 con 0x7fc218003a50 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220005890 con 0x7fc218003a50 2024-08-17T02:27:47.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7fc22ea00640 1 -- 172.21.15.46:0/1857190184 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220005cd0 con 0x7fc218003a50 2024-08-17T02:27:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 -- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 msgr2=0x7f1ad0038700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0038700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009850 tx=0x7f1acc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 -- 172.21.15.46:0/3236463144 shutdown_connections 2024-08-17T02:27:47.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad0038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 --2- 172.21.15.46:0/3236463144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0038700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.517+0000 7f1adcc00640 1 -- 172.21.15.46:0/3236463144 >> 172.21.15.46:0/3236463144 conn(0x7f1ad000f050 msgr2=0x7f1ad0058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7f1adcc00640 1 -- 172.21.15.46:0/3236463144 shutdown_connections 2024-08-17T02:27:47.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7f1adcc00640 1 -- 172.21.15.46:0/3236463144 wait complete. 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7fc235600640 1 -- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 msgr2=0x7fc218003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7fc235600640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 0x7fc218003e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc220001ed0 tx=0x7fc220001e60 comp rx=0 tx=0).stop 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7fc235600640 1 -- 172.21.15.46:0/1857190184 shutdown_connections 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.518+0000 7fc235600640 1 --2- 172.21.15.46:0/1857190184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc218003a50 0x7fc218003e40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.519+0000 7fc235600640 1 -- 172.21.15.46:0/1857190184 >> 172.21.15.46:0/1857190184 conn(0x7fc22800a7d0 msgr2=0x7fc228056da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.519+0000 7fc235600640 1 -- 172.21.15.46:0/1857190184 shutdown_connections 2024-08-17T02:27:47.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.519+0000 7fc235600640 1 -- 172.21.15.46:0/1857190184 wait complete. 2024-08-17T02:27:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7ff429e00640 1 Processor -- start 2024-08-17T02:27:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7ff429e00640 1 -- start start 2024-08-17T02:27:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7fc235600640 1 Processor -- start 2024-08-17T02:27:47.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7fa00a400640 1 Processor -- start 2024-08-17T02:27:47.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7f1adcc00640 1 Processor -- start 2024-08-17T02:27:47.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.522+0000 7f1adcc00640 1 -- start start 2024-08-17T02:27:47.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.521+0000 7fc235600640 1 -- start start 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7fc235600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 0x7fc2280e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 0x7f1ad003d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0052150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad00e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad000ba50 con 0x7f1ad00e6220 2024-08-17T02:27:47.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad000bd30 con 0x7f1ad00e7600 2024-08-17T02:27:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.523+0000 7f1adcc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad000c010 con 0x7f1ad00eac50 2024-08-17T02:27:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.522+0000 7fa00a400640 1 -- start start 2024-08-17T02:27:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fa00a400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa00413e360 0x7fa0040adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fa00a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa00406a5e0 0x7fa0040aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fa00a400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040af6e0 con 0x7fa00413e730 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fa00a400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040acb40 con 0x7fa00406a5e0 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fa00a400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0040ad6c0 con 0x7fa00413e360 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff41c0e2020 0x7ff41c03aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff41c039090 0x7ff41c0378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c007a30 con 0x7ff41c039090 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0394f0 con 0x7ff41c0e2020 2024-08-17T02:27:47.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7ff429e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c006e20 con 0x7ff41c03b3f0 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 0x7f1ad003d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc235600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280ed240 0x7fc2280e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc235600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 0x7fc2280f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc235600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280e1c50 con 0x7fc218003a50 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc235600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228037900 con 0x7fc2280ed240 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc235600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc228037ba0 con 0x7fc2280e17e0 2024-08-17T02:27:47.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc22fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 0x7fc2280e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc22fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 0x7fc2280e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40788/0 (socket says 172.21.15.46:40788) 2024-08-17T02:27:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7fc22fe00640 1 -- 172.21.15.46:0/2248661277 learned_addr learned my addr 172.21.15.46:0/2248661277 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 0x7fc2280f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7ff428a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff41c0e2020 0x7ff41c03aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fa002a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa00413e730 0x7fa004069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46044/0 (socket says 172.21.15.46:46044) 2024-08-17T02:27:47.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7ff423e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7ff429400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff41c039090 0x7ff41c0378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7ff423e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:43068/0 (socket says 172.21.15.46:43068) 2024-08-17T02:27:47.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7ff423e00640 1 -- 172.21.15.46:0/2145083756 learned_addr learned my addr 172.21.15.46:0/2145083756 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fa002a00640 1 -- 172.21.15.46:0/1623081869 learned_addr learned my addr 172.21.15.46:0/1623081869 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fa003400640 1 --2- 172.21.15.46:0/1623081869 >> v2:172.21.15.162:3300/0 conn(0x7fa00413e360 0x7fa0040adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 -- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280ed240 msgr2=0x7fc2280e12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280ed240 0x7fc2280e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 -- 172.21.15.46:0/2248661277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 msgr2=0x7fc2280e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 0x7fc2280e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.525+0000 7fc234c00640 1 -- 172.21.15.46:0/2248661277 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228037e80 con 0x7fc2280e17e0 2024-08-17T02:27:47.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7f1ad7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad00e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7f1ad7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad00e39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:43054/0 (socket says 172.21.15.46:43054) 2024-08-17T02:27:47.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.524+0000 7f1ad7e00640 1 -- 172.21.15.46:0/2541030595 learned_addr learned my addr 172.21.15.46:0/2541030595 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0052150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7fc234c00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 0x7fc2280f0fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc230065aa0 tx=0x7fc230069040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7fa003e00640 1 --2- 172.21.15.46:0/1623081869 >> v2:172.21.15.46:3300/0 conn(0x7fa00406a5e0 0x7fa0040aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230063d20 con 0x7fc2280e17e0 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc228038160 con 0x7fc2280e17e0 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230063e80 con 0x7fc2280e17e0 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7fa002000640 1 -- 172.21.15.46:0/1623081869 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121786757 0 0) 0x7fa0040af6e0 con 0x7fa00413e730 2024-08-17T02:27:47.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7fa002000640 1 -- 172.21.15.46:0/1623081869 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe80034e0 con 0x7fa00413e730 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7ff423e00640 1 -- 172.21.15.46:0/2145083756 >> v2:172.21.15.162:3300/0 conn(0x7ff41c0e2020 msgr2=0x7ff41c03aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7ff423e00640 1 --2- 172.21.15.46:0/2145083756 >> v2:172.21.15.162:3300/0 conn(0x7ff41c0e2020 0x7ff41c03aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7ff423e00640 1 -- 172.21.15.46:0/2145083756 >> v2:172.21.15.46:3300/0 conn(0x7ff41c039090 msgr2=0x7ff41c0378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7ff423e00640 1 --2- 172.21.15.46:0/2145083756 >> v2:172.21.15.46:3300/0 conn(0x7ff41c039090 0x7ff41c0378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7ff423e00640 1 -- 172.21.15.46:0/2145083756 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c007100 con 0x7ff41c03b3f0 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fa003400640 1 -- 172.21.15.46:0/1623081869 >> v2:172.21.15.46:3300/0 conn(0x7fa00406a5e0 msgr2=0x7fa0040aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fa003400640 1 --2- 172.21.15.46:0/1623081869 >> v2:172.21.15.46:3300/0 conn(0x7fa00406a5e0 0x7fa0040aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fa003400640 1 -- 172.21.15.46:0/1623081869 >> v1:172.21.15.162:6789/0 conn(0x7fa00413e730 legacy=0x7fa004069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fa003400640 1 -- 172.21.15.46:0/1623081869 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040acd90 con 0x7fa00413e360 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad7400640 1 -- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 msgr2=0x7f1ad00e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad7400640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad00e39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad7400640 1 -- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 msgr2=0x7f1ad0052150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad7400640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0052150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.526+0000 7f1ad7400640 1 -- 172.21.15.46:0/2541030595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009390 con 0x7f1ad00e6220 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.528+0000 7f1ad7400640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 0x7f1ad003d960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8060af0 tx=0x7f1ad806f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.528+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad806f470 con 0x7f1ad00e6220 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2280e0aa0 con 0x7fc2280e17e0 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.527+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230063d20 con 0x7fc2280e17e0 2024-08-17T02:27:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7ff423e00640 1 --2- 172.21.15.46:0/2145083756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff41c012160 tx=0x7ff4180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967761d51594ac74 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7faae7800640 1 Processor -- start 2024-08-17T02:27:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7faae7800640 1 -- start start 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7ff423400640 1 -- 172.21.15.46:0/2145083756 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41802ad10 con 0x7ff41c03b3f0 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7ff423400640 1 -- 172.21.15.46:0/2145083756 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41802ae70 con 0x7ff41c03b3f0 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7ff423400640 1 -- 172.21.15.46:0/2145083756 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418032650 con 0x7ff41c03b3f0 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad000c2f0 con 0x7f1ad00e6220 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.529+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad003dea0 con 0x7f1ad00e6220 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad808f3b0 con 0x7f1ad00e6220 2024-08-17T02:27:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad808f7b0 con 0x7f1ad00e6220 2024-08-17T02:27:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c005210 con 0x7fc2280e17e0 2024-08-17T02:27:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7ff429e00640 1 -- 172.21.15.46:0/2145083756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 msgr2=0x7ff41c038b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7ff429e00640 1 --2- 172.21.15.46:0/2145083756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff41c012160 tx=0x7ff4180091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7f465b400640 1 Processor -- start 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7f465b400640 1 -- start start 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7faae7800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faae00b1120 0x7faae00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7faae7800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00d0ab0 con 0x7faae00b3370 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7faae7800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae00b00c0 con 0x7faae00ada10 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.531+0000 7faae7800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae00af330 con 0x7faae00b1120 2024-08-17T02:27:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7faae4e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7faae00ada10 0x7faae00b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46054/0 (socket says 172.21.15.46:46054) 2024-08-17T02:27:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 -- 172.21.15.46:0/2145083756 shutdown_connections 2024-08-17T02:27:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 --2- 172.21.15.46:0/2145083756 >> v2:172.21.15.46:3300/0 conn(0x7ff41c039090 0x7ff41c0378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7faae4e00640 1 -- 172.21.15.46:0/637440119 learned_addr learned my addr 172.21.15.46:0/637440119 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 --2- 172.21.15.46:0/2145083756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c03b3f0 0x7ff41c038b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 --2- 172.21.15.46:0/2145083756 >> v2:172.21.15.162:3300/0 conn(0x7ff41c0e2020 0x7ff41c03aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.530+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc230064320 con 0x7fc2280e17e0 2024-08-17T02:27:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7fc21f400640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 0x7fc214067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc2300c9e60 con 0x7fc2280e17e0 2024-08-17T02:27:47.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 -- 172.21.15.46:0/2145083756 >> 172.21.15.46:0/2145083756 conn(0x7ff41c00f050 msgr2=0x7ff41c058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab4005210 con 0x7f1ad00e6220 2024-08-17T02:27:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7ff429e00640 1 -- 172.21.15.46:0/2145083756 shutdown_connections 2024-08-17T02:27:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7fa003400640 1 --2- 172.21.15.46:0/1623081869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa0040adb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0040647c0 tx=0x7f9ff40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c341bace139ac252 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.532+0000 7faadfe00640 1 --2- 172.21.15.46:0/637440119 >> v2:172.21.15.46:3300/0 conn(0x7faae00b1120 0x7faae00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fc22fe00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 0x7fc214067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7faadf400640 1 -- 172.21.15.46:0/637440119 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124542346 0 0) 0x7faae00b00c0 con 0x7faae00ada10 2024-08-17T02:27:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7faadf400640 1 -- 172.21.15.46:0/637440119 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac80034e0 con 0x7faae00ada10 2024-08-17T02:27:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fa002000640 1 -- 172.21.15.46:0/1623081869 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff402ad20 con 0x7fa00413e360 2024-08-17T02:27:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fa002000640 1 -- 172.21.15.46:0/1623081869 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff402ae80 con 0x7fa00413e360 2024-08-17T02:27:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fa002000640 1 -- 172.21.15.46:0/1623081869 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4032670 con 0x7fa00413e360 2024-08-17T02:27:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7faadfe00640 1 -- 172.21.15.46:0/637440119 >> v1:172.21.15.162:6789/0 conn(0x7faae00ada10 legacy=0x7faae00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f465b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7faadfe00640 1 -- 172.21.15.46:0/637440119 >> v1:172.21.15.46:6789/0 conn(0x7faae00b3370 legacy=0x7faae01629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7faadfe00640 1 -- 172.21.15.46:0/637440119 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae00b0360 con 0x7faae00b1120 2024-08-17T02:27:47.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1ad808fbe0 con 0x7f1ad00e6220 2024-08-17T02:27:47.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7ff429e00640 1 -- 172.21.15.46:0/2145083756 wait complete. 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f4658a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f4658a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:43082/0 (socket says 172.21.15.46:43082) 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f4658a00640 1 -- 172.21.15.46:0/4010261629 learned_addr learned my addr 172.21.15.46:0/4010261629 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540af6e0 con 0x7f465406a5e0 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46540acb40 con 0x7f465406e7f0 2024-08-17T02:27:47.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540ad6c0 con 0x7f465413e360 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fa00a400640 1 -- 172.21.15.46:0/1623081869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 msgr2=0x7fa0040adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7fa00a400640 1 --2- 172.21.15.46:0/1623081869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa0040adb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0040647c0 tx=0x7f9ff40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7fa00a400640 1 -- 172.21.15.46:0/1623081869 shutdown_connections 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7fa00a400640 1 --2- 172.21.15.46:0/1623081869 >> v2:172.21.15.46:3300/0 conn(0x7fa00406a5e0 0x7fa0040aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7fa00a400640 1 --2- 172.21.15.46:0/1623081869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa0040adb50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7fa00a400640 1 -- 172.21.15.46:0/1623081869 >> 172.21.15.46:0/1623081869 conn(0x7fa0040cc480 msgr2=0x7fa0040687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7faadfe00640 1 --2- 172.21.15.46:0/637440119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b1120 0x7faae00aedf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faacc009850 tx=0x7faacc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ce2f2527bbf0cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7fa00a400640 1 -- 172.21.15.46:0/1623081869 shutdown_connections 2024-08-17T02:27:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7faadf400640 1 -- 172.21.15.46:0/637440119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc02adb0 con 0x7faae00b1120 2024-08-17T02:27:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7faadf400640 1 -- 172.21.15.46:0/637440119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc032440 con 0x7faae00b1120 2024-08-17T02:27:47.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7faadf400640 1 -- 172.21.15.46:0/637440119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0327e0 con 0x7faae00b1120 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f6399600640 1 Processor -- start 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.534+0000 7f6399600640 1 -- start start 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7f6399600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406d7f0 0x7f63940aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7f6399600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f63940b10d0 0x7f639406dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7f6399600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940b1900 con 0x7f639406e100 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7f6399600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940b1be0 con 0x7f63940b10d0 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.535+0000 7f6399600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940c8570 con 0x7f639406d7f0 2024-08-17T02:27:47.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7ff429e00640 1 Processor -- start 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7faae7800640 1 -- 172.21.15.46:0/637440119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b1120 msgr2=0x7faae00aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7faae7800640 1 --2- 172.21.15.46:0/637440119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b1120 0x7faae00aedf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faacc009850 tx=0x7faacc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f4653400640 1 -- 172.21.15.46:0/4010261629 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908909648 0 0) 0x7f46540acb40 con 0x7f465406e7f0 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f4653400640 1 -- 172.21.15.46:0/4010261629 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463c0034e0 con 0x7f465406e7f0 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f4658a00640 1 -- 172.21.15.46:0/4010261629 >> v1:172.21.15.162:6789/0 conn(0x7f465406e7f0 legacy=0x7f4654069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f4658a00640 1 -- 172.21.15.46:0/4010261629 >> v1:172.21.15.46:6789/0 conn(0x7f465406a5e0 legacy=0x7f46540aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f4658a00640 1 -- 172.21.15.46:0/4010261629 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540acd90 con 0x7f465413e360 2024-08-17T02:27:47.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f1acaa00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 0x7f1ab8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ad80f8e20 con 0x7f1ad00e6220 2024-08-17T02:27:47.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 0x7f1ab8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f6392000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f63940b10d0 0x7f639406dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f6392000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f63940b10d0 0x7f639406dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40852/0 (socket says 172.21.15.46:40852) 2024-08-17T02:27:47.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7f6392000640 1 -- 172.21.15.46:0/165439901 learned_addr learned my addr 172.21.15.46:0/165439901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f6392a00640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406d7f0 0x7f63940aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7ff429e00640 1 -- start start 2024-08-17T02:27:47.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7fc22fe00640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 0x7fc214067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc220005860 tx=0x7fc220034000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.536+0000 7fa00a400640 1 -- 172.21.15.46:0/1623081869 wait complete. 2024-08-17T02:27:47.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7fa00a400640 1 Processor -- start 2024-08-17T02:27:47.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f6392000640 1 -- 172.21.15.46:0/165439901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406d7f0 msgr2=0x7f63940aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7f1ad6a00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 0x7f1ab8067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1acc034000 tx=0x7f1acc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f6392000640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406d7f0 0x7f63940aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7f4658a00640 1 --2- 172.21.15.46:0/4010261629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4640009940 tx=0x7f46400091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8ceeaa5edfa251 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7faae7800640 1 -- 172.21.15.46:0/637440119 shutdown_connections 2024-08-17T02:27:47.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7faae7800640 1 --2- 172.21.15.46:0/637440119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b1120 0x7faae00aedf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7faae7800640 1 -- 172.21.15.46:0/637440119 >> 172.21.15.46:0/637440119 conn(0x7faae00cfdf0 msgr2=0x7faae00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f6392000640 1 -- 172.21.15.46:0/165439901 >> v1:172.21.15.46:6789/0 conn(0x7f639406e100 legacy=0x7f63940c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c039090 0x7ff41c0d9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c03b3f0 0x7ff41c0e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.537+0000 7f6392000640 1 -- 172.21.15.46:0/165439901 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940c8850 con 0x7f63940b10d0 2024-08-17T02:27:47.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7f4653400640 1 -- 172.21.15.46:0/4010261629 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640032440 con 0x7f465413e360 2024-08-17T02:27:47.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0d8080 con 0x7ff41c0e2020 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c050340 con 0x7ff41c03b3f0 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7ff429e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c050620 con 0x7ff41c039090 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7faae7800640 1 -- 172.21.15.46:0/637440119 shutdown_connections 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7faae7800640 1 -- 172.21.15.46:0/637440119 wait complete. 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff423e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c03b3f0 0x7ff41c0e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40860/0 (socket says 172.21.15.46:40860) 2024-08-17T02:27:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 -- 172.21.15.46:0/2788453379 learned_addr learned my addr 172.21.15.46:0/2788453379 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.538+0000 7fa00a400640 1 -- start start 2024-08-17T02:27:47.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2300c6230 con 0x7fc2280e17e0 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 -- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c039090 msgr2=0x7ff41c0d9750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c039090 0x7ff41c0d9750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 -- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c03b3f0 msgr2=0x7ff41c0e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c03b3f0 0x7ff41c0e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7ff429400640 1 -- 172.21.15.46:0/2788453379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418009450 con 0x7ff41c0e2020 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7f4653400640 1 -- 172.21.15.46:0/4010261629 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400325a0 con 0x7f465413e360 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.539+0000 7f4653400640 1 -- 172.21.15.46:0/4010261629 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640032980 con 0x7f465413e360 2024-08-17T02:27:47.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 msgr2=0x7f46540adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 --2- 172.21.15.46:0/4010261629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4640009940 tx=0x7f46400091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7fa00a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00406a5e0 0x7fa0041757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7ff429400640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff42404c780 tx=0x7ff424069040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f6392000640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f639406dbc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6380009940 tx=0x7f63800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653604dae61ae6b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 shutdown_connections 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 --2- 172.21.15.46:0/4010261629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46540adb50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 >> 172.21.15.46:0/4010261629 conn(0x7f46540cc480 msgr2=0x7f46540687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 shutdown_connections 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7f465b400640 1 -- 172.21.15.46:0/4010261629 wait complete. 2024-08-17T02:27:47.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7fa00a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa004175d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7faae7800640 1 Processor -- start 2024-08-17T02:27:47.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.540+0000 7fa00a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa00a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00413c190 con 0x7fa00413e730 2024-08-17T02:27:47.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7faae7800640 1 -- start start 2024-08-17T02:27:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa00a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa004139c80 con 0x7fa00413e360 2024-08-17T02:27:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa00a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041396c0 con 0x7fa00406a5e0 2024-08-17T02:27:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa003e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa003e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40876/0 (socket says 172.21.15.46:40876) 2024-08-17T02:27:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa003e00640 1 -- 172.21.15.46:0/2808577357 learned_addr learned my addr 172.21.15.46:0/2808577357 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa003400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00406a5e0 0x7fa0041757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 0x7faae0152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 0x7faae01690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.541+0000 7fa002a00640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa004175d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 0x7faae0157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00cdbc0 con 0x7faae00b3370 2024-08-17T02:27:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00ce460 con 0x7faae00ada10 2024-08-17T02:27:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae7800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae009b3a0 con 0x7faae00b1120 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 -- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00406a5e0 msgr2=0x7fa0041757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00406a5e0 0x7fa0041757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 -- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 msgr2=0x7fa004175d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa004175d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 -- 172.21.15.46:0/2808577357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009390 con 0x7fa00413e730 2024-08-17T02:27:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7fa003e00640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc008840 tx=0x7f9ffc007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae5800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 0x7faae0157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.542+0000 7faae4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 0x7faae0152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 0x7faae01690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faae4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 0x7faae0152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60768/0 (socket says 172.21.15.46:60768) 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faae4e00640 1 -- 172.21.15.46:0/3050305676 learned_addr learned my addr 172.21.15.46:0/3050305676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 -- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 msgr2=0x7faae0152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 0x7faae0152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 -- 172.21.15.46:0/3050305676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 msgr2=0x7faae0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 0x7faae0157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faadfe00640 1 -- 172.21.15.46:0/3050305676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009390 con 0x7faae00b1120 2024-08-17T02:27:47.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.543+0000 7faae5800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 0x7faae0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:47.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faadfe00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 0x7faae01690b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faacc031000 tx=0x7faacc032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7f465b400640 1 Processor -- start 2024-08-17T02:27:47.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7f465b400640 1 -- start start 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc000d10 con 0x7faae00b1120 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc031a60 con 0x7faae00b1120 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc031e20 con 0x7faae00b1120 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00cde10 con 0x7faae00b1120 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae01530f0 con 0x7faae00b1120 2024-08-17T02:27:47.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc010040 con 0x7fa00413e730 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00bac0 con 0x7fa00413e730 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc016620 con 0x7fa00413e730 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4240650e0 con 0x7ff41c0e2020 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42408c4a0 con 0x7ff41c0e2020 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42408c860 con 0x7ff41c0e2020 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f6391600640 1 -- 172.21.15.46:0/165439901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638002ae40 con 0x7f63940b10d0 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f6391600640 1 -- 172.21.15.46:0/165439901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6380032440 con 0x7f63940b10d0 2024-08-17T02:27:47.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f6391600640 1 -- 172.21.15.46:0/165439901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380032820 con 0x7f63940b10d0 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7f465b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 0x7f46540a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.545+0000 7f465b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 0x7f4654157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f465b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46541578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f465b400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654156f00 con 0x7f465406a5e0 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f465b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541562f0 con 0x7f465406e7f0 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c050900 con 0x7ff41c0e2020 2024-08-17T02:27:47.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c04ff80 con 0x7ff41c0e2020 2024-08-17T02:27:47.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1ad80c6f90 con 0x7f1ad00e6220 2024-08-17T02:27:47.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae01532e0 con 0x7faae00b1120 2024-08-17T02:27:47.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.546+0000 7f465b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46541565d0 con 0x7f465413e360 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 -- 172.21.15.46:0/165439901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 msgr2=0x7f639406dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f639406dbc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6380009940 tx=0x7f63800091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 -- 172.21.15.46:0/165439901 shutdown_connections 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f639406dbc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 --2- 172.21.15.46:0/165439901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406d7f0 0x7f63940aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f6399600640 1 -- 172.21.15.46:0/165439901 >> 172.21.15.46:0/165439901 conn(0x7f63940cb9b0 msgr2=0x7f63940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f4653e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 0x7f4654157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f4653e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 0x7f4654157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:60770/0 (socket says 172.21.15.46:60770) 2024-08-17T02:27:47.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0041399a0 con 0x7fa00413e730 2024-08-17T02:27:47.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa004157880 con 0x7fa00413e730 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f4653e00640 1 -- 172.21.15.46:0/428766460 learned_addr learned my addr 172.21.15.46:0/428766460 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f4658a00640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 0x7f46540a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.548+0000 7f4659400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46541578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 -- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 msgr2=0x7f4654157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 0x7f4654157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 -- 172.21.15.46:0/428766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 msgr2=0x7f46540a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 0x7f46540a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00413c340 con 0x7fa00413e730 2024-08-17T02:27:47.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 -- 172.21.15.46:0/428766460 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640009450 con 0x7f465413e360 2024-08-17T02:27:47.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4658a00640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 0x7f46540a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:47.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7f4659400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46541578d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f465406a9e0 tx=0x7f464c012a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faacc043030 con 0x7faae00b1120 2024-08-17T02:27:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7faad3e00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 0x7faac0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faacc041070 con 0x7faae00b1120 2024-08-17T02:27:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.551+0000 7faae4e00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 0x7faac0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.549+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff42408cc90 con 0x7ff41c0e2020 2024-08-17T02:27:47.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7faae4e00640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 0x7faac0067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faad4007b80 tx=0x7faad4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7ff417e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 0x7ff404067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4240f9110 con 0x7ff41c0e2020 2024-08-17T02:27:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7f6399600640 1 -- 172.21.15.46:0/165439901 shutdown_connections 2024-08-17T02:27:47.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7f6399600640 1 -- 172.21.15.46:0/165439901 wait complete. 2024-08-17T02:27:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7ff428a00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 0x7ff404067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ffc020440 con 0x7fa00413e730 2024-08-17T02:27:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7f6399600640 1 Processor -- start 2024-08-17T02:27:47.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff400005210 con 0x7ff41c0e2020 2024-08-17T02:27:47.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.552+0000 7f6399600640 1 -- start start 2024-08-17T02:27:47.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7ff428a00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 0x7ff404067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff410009a80 tx=0x7ff4100090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 0x7f63940ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406e100 0x7f63940add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394159d90 con 0x7f63940b10d0 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394159230 con 0x7f639406d7f0 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.553+0000 7f6399600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639415a010 con 0x7f639406e100 2024-08-17T02:27:47.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6392a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 0x7f63940ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c017070 con 0x7f465413e360 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c014d70 con 0x7f465413e360 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46541568b0 con 0x7f465413e360 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.555+0000 7f9ffaa00640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 0x7f9fe40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.555+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ffc082fa0 con 0x7fa00413e730 2024-08-17T02:27:47.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.555+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faacc070fc0 con 0x7faae00b1120 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6393400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6393400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40904/0 (socket says 172.21.15.46:40904) 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6393400640 1 -- 172.21.15.46:0/1881518262 learned_addr learned my addr 172.21.15.46:0/1881518262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6392000640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406e100 0x7f63940add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c012300 con 0x7f465413e360 2024-08-17T02:27:47.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.555+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46540a5a10 con 0x7f465413e360 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6393400640 1 -- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406e100 msgr2=0x7f63940add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.554+0000 7f6393400640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406e100 0x7f63940add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.555+0000 7f6393400640 1 -- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 msgr2=0x7f63940ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.557+0000 7f6393400640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 0x7f63940ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.557+0000 7f6393400640 1 -- 172.21.15.46:0/1881518262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009450 con 0x7f63940b10d0 2024-08-17T02:27:47.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.557+0000 7f6392a00640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 0x7f63940ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.558+0000 7fa003400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 0x7f9fe40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.558+0000 7f6393400640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c810 tx=0x7f638c001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.558+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f464c003030 con 0x7f465413e360 2024-08-17T02:27:47.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46541570b0 con 0x7f465413e360 2024-08-17T02:27:47.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ffc051330 con 0x7fa00413e730 2024-08-17T02:27:47.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7fa003400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 0x7f9fe40676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4034000 tx=0x7f9ff4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7f4647e00640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 0x7f4634067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f464c089fb0 con 0x7f465413e360 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.559+0000 7f4658a00640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 0x7f4634067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.561+0000 7f4658a00640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 0x7f4634067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4640034000 tx=0x7f4640032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00a5e0 con 0x7f63940b10d0 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c00a740 con 0x7f63940b10d0 2024-08-17T02:27:47.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00ab40 con 0x7f63940b10d0 2024-08-17T02:27:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46541570b0 con 0x7f465413e360 2024-08-17T02:27:47.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff4240c7260 con 0x7ff41c0e2020 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639415cb30 con 0x7f63940b10d0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.563+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639415d0f0 con 0x7f63940b10d0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.566+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f638c003030 con 0x7f63940b10d0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.566+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639415a180 con 0x7f63940b10d0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.566+0000 7f638a000640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 0x7f63740676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.567+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f638c054770 con 0x7f63940b10d0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.567+0000 7f6392a00640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 0x7f63740676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.569+0000 7f6392a00640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 0x7f63740676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6384006e70 tx=0x7f6384008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.573+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f638c050b40 con 0x7f63940b10d0 2024-08-17T02:27:47.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.895+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc9980054c0 con 0x7fc9bc0504b0 2024-08-17T02:27:47.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.895+0000 7fc9b9600640 1 -- 172.21.15.46:0/3182713852 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9b007cd90 con 0x7fc9bc0504b0 2024-08-17T02:27:47.898 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:47.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.899+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 msgr2=0x7fc9a4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.900+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 0x7fc9a4067680 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40018f0 tx=0x7fc9b4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:47.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.900+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 msgr2=0x7fc9bc0d5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.900+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0039000 tx=0x7fc9b003d000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.900+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 shutdown_connections 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.901+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9bc0d86d0 0x7fc9bc039420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.901+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9bc0504b0 0x7fc9bc0d5640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.901+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc9a40651d0 0x7fc9a4067680 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.901+0000 7fc9aea00640 1 --2- 172.21.15.46:0/3182713852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9bc04f1d0 0x7fc9bc04bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.901+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 >> 172.21.15.46:0/3182713852 conn(0x7fc9bc051600 msgr2=0x7fc9bc049af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.902+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 shutdown_connections 2024-08-17T02:27:47.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.902+0000 7fc9aea00640 1 -- 172.21.15.46:0/3182713852 wait complete. 2024-08-17T02:27:47.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-08-17T02:27:47.928 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:47.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.941+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc20c005790 con 0x7fc2280e17e0 2024-08-17T02:27:47.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.942+0000 7fc21f400640 1 -- 172.21.15.46:0/2248661277 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2300c63d0 con 0x7fc2280e17e0 2024-08-17T02:27:47.942 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.944+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 msgr2=0x7fc214067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.944+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 0x7fc214067660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc220005860 tx=0x7fc220034000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 msgr2=0x7fc2280f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 0x7fc2280f0fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc230065aa0 tx=0x7fc230069040 comp rx=0 tx=0).stop 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 shutdown_connections 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc2140651b0 0x7fc214067660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2280e17e0 0x7fc2280f0fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2280ed240 0x7fc2280e12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 --2- 172.21.15.46:0/2248661277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc218003a50 0x7fc2280e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 >> 172.21.15.46:0/2248661277 conn(0x7fc22800a7d0 msgr2=0x7fc22804c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 shutdown_connections 2024-08-17T02:27:47.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.945+0000 7fc235600640 1 -- 172.21.15.46:0/2248661277 wait complete. 2024-08-17T02:27:47.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-08-17T02:27:47.963 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:47.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.972+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ab4005790 con 0x7f1ad00e6220 2024-08-17T02:27:47.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.973+0000 7f1acaa00640 1 -- 172.21.15.46:0/2541030595 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ad8095020 con 0x7f1ad00e6220 2024-08-17T02:27:47.973 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:47.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.973+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faae0064db0 con 0x7faae00b1120 2024-08-17T02:27:47.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.975+0000 7faad3e00640 1 -- 172.21.15.46:0/3050305676 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faacc04b090 con 0x7faae00b1120 2024-08-17T02:27:47.976 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.976+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 msgr2=0x7f1ab8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.976+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 0x7f1ab8067600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1acc034000 tx=0x7f1acc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.976+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 msgr2=0x7f1ad003d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.976+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 0x7f1ad003d960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8060af0 tx=0x7f1ad806f710 comp rx=0 tx=0).stop 2024-08-17T02:27:47.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa004064db0 con 0x7fa00413e730 2024-08-17T02:27:47.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 shutdown_connections 2024-08-17T02:27:47.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1ab8065150 0x7f1ab8067600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ad00eac50 0x7f1ad00e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ad00e7600 0x7f1ad0052150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 --2- 172.21.15.46:0/2541030595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ad00e6220 0x7f1ad003d960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 >> 172.21.15.46:0/2541030595 conn(0x7f1ad000f050 msgr2=0x7f1ad00e82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.978+0000 7f9ffaa00640 1 -- 172.21.15.46:0/2808577357 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ffc01b090 con 0x7fa00413e730 2024-08-17T02:27:47.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.977+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 shutdown_connections 2024-08-17T02:27:47.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.978+0000 7f1adcc00640 1 -- 172.21.15.46:0/2541030595 wait complete. 2024-08-17T02:27:47.979 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:47.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 msgr2=0x7faac0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 0x7faac0067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faad4007b80 tx=0x7faad4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 msgr2=0x7faae01690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 0x7faae01690b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faacc031000 tx=0x7faacc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 shutdown_connections 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faae00b3370 0x7faae0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faac0065150 0x7faac0067600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00b1120 0x7faae01690b0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faacc031000 tx=0x7faacc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 --2- 172.21.15.46:0/3050305676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae00ada10 0x7faae0152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.979+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 >> 172.21.15.46:0/3050305676 conn(0x7faae00cfdf0 msgr2=0x7faae0067720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.980+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 shutdown_connections 2024-08-17T02:27:47.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.980+0000 7faae7800640 1 -- 172.21.15.46:0/3050305676 wait complete. 2024-08-17T02:27:47.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 msgr2=0x7f9fe40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 0x7f9fe40676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4034000 tx=0x7f9ff4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4654156710 con 0x7f465413e360 2024-08-17T02:27:47.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 msgr2=0x7fa004157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc008840 tx=0x7f9ffc007620 comp rx=0 tx=0).stop 2024-08-17T02:27:47.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 shutdown_connections 2024-08-17T02:27:47.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.983+0000 7f4647e00640 1 -- 172.21.15.46:0/428766460 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4654156710 con 0x7f465413e360 2024-08-17T02:27:47.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa00413e730 0x7fa004157340 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa00413e360 0x7fa004175d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.984 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:47.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9fe4065220 0x7f9fe40676d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 --2- 172.21.15.46:0/2808577357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa00406a5e0 0x7fa0041757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.982+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 >> 172.21.15.46:0/2808577357 conn(0x7fa0040cc480 msgr2=0x7fa0040ac190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.983+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 shutdown_connections 2024-08-17T02:27:47.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.983+0000 7fa00a400640 1 -- 172.21.15.46:0/2808577357 wait complete. 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.986+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 msgr2=0x7f4634067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.986+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 0x7f4634067600 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4640034000 tx=0x7f4640032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.986+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 msgr2=0x7f46541578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.986+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46541578d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f465406a9e0 tx=0x7f464c012a30 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 shutdown_connections 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4634065150 0x7f4634067600 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4640034000 tx=0x7f4640032000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f465413e360 0x7f46541578d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f465406e7f0 0x7f4654157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 --2- 172.21.15.46:0/428766460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f465406a5e0 0x7f46540a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 >> 172.21.15.46:0/428766460 conn(0x7f46540cc480 msgr2=0x7f465414ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 shutdown_connections 2024-08-17T02:27:47.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.987+0000 7f465b400640 1 -- 172.21.15.46:0/428766460 wait complete. 2024-08-17T02:27:47.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.996+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4000054c0 con 0x7ff41c0e2020 2024-08-17T02:27:47.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:47.997+0000 7ff417e00640 1 -- 172.21.15.46:0/2788453379 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff424094030 con 0x7ff41c0e2020 2024-08-17T02:27:47.997 INFO:teuthology.orchestra.run.smithi046.stdout:55834574854 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.000+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6394064db0 con 0x7f63940b10d0 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.000+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 msgr2=0x7ff404067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.000+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 0x7ff404067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff410009a80 tx=0x7ff4100090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.000+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 msgr2=0x7ff41c0e2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.000+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff42404c780 tx=0x7ff424069040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7f638a000640 1 -- 172.21.15.46:0/1881518262 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f638c050b40 con 0x7f63940b10d0 2024-08-17T02:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 shutdown_connections 2024-08-17T02:27:48.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff41c0e2020 0x7ff41c0e2930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c03b3f0 0x7ff41c0e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff4040652a0 0x7ff404067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 --2- 172.21.15.46:0/2788453379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c039090 0x7ff41c0d9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 >> 172.21.15.46:0/2788453379 conn(0x7ff41c00f050 msgr2=0x7ff41c057480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.002 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 shutdown_connections 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.001+0000 7ff429e00640 1 -- 172.21.15.46:0/2788453379 wait complete. 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.003+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 msgr2=0x7f63740676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.003+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 0x7f63740676d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6384006e70 tx=0x7f6384008040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.003+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 msgr2=0x7f63940c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.003+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c810 tx=0x7f638c001660 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 shutdown_connections 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63940b10d0 0x7f63940c6610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6374065220 0x7f63740676d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639406e100 0x7f63940add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 --2- 172.21.15.46:0/1881518262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f639406d7f0 0x7f63940ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 >> 172.21.15.46:0/1881518262 conn(0x7f63940cb9b0 msgr2=0x7f63940cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 shutdown_connections 2024-08-17T02:27:48.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.004+0000 7f6399600640 1 -- 172.21.15.46:0/1881518262 wait complete. 2024-08-17T02:27:48.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-08-17T02:27:48.006 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-08-17T02:27:48.007 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-08-17T02:27:48.008 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-08-17T02:27:48.010 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-08-17T02:27:48.022 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-08-17T02:27:48.026 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:48.026 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:48.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:48.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.218+0000 7f5835600640 1 Processor -- start 2024-08-17T02:27:48.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.218+0000 7f5835600640 1 -- start start 2024-08-17T02:27:48.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f5835600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58300af6d0 0x7f58300aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f5835600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f5835600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300afb50 con 0x7f5830158cb0 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f5835600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300aae50 con 0x7f58300af6d0 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f5835600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300abc80 con 0x7f58300ac820 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.219+0000 7f582e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58300af6d0 0x7f58300aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f58300af6d0 0x7f58300aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40918/0 (socket says 172.21.15.46:40918) 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 -- 172.21.15.46:0/3804816662 learned_addr learned my addr 172.21.15.46:0/3804816662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582f400640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 -- 172.21.15.46:0/3804816662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 msgr2=0x7f5830159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 -- 172.21.15.46:0/3804816662 >> v1:172.21.15.162:6789/0 conn(0x7f5830158cb0 legacy=0x7f58300ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.220+0000 7f582e000640 1 -- 172.21.15.46:0/3804816662 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300ab070 con 0x7f58300af6d0 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.221+0000 7f582e000640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58300af6d0 0x7f58300aa910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f581c009910 tx=0x7f581c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b42cf6c71819a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.221+0000 7f582d600640 1 -- 172.21.15.46:0/3804816662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c02ae40 con 0x7f58300af6d0 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.221+0000 7f582d600640 1 -- 172.21.15.46:0/3804816662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c032440 con 0x7f58300af6d0 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.221+0000 7f582d600640 1 -- 172.21.15.46:0/3804816662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c032820 con 0x7f58300af6d0 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 -- 172.21.15.46:0/3804816662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58300af6d0 msgr2=0x7f58300aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58300af6d0 0x7f58300aa910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f581c009910 tx=0x7f581c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 -- 172.21.15.46:0/3804816662 shutdown_connections 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 --2- 172.21.15.46:0/3804816662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58300af6d0 0x7f58300aa910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 -- 172.21.15.46:0/3804816662 >> 172.21.15.46:0/3804816662 conn(0x7f5830096a70 msgr2=0x7f5830096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 -- 172.21.15.46:0/3804816662 shutdown_connections 2024-08-17T02:27:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.222+0000 7f5835600640 1 -- 172.21.15.46:0/3804816662 wait complete. 2024-08-17T02:27:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.223+0000 7f5835600640 1 Processor -- start 2024-08-17T02:27:48.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.223+0000 7f5835600640 1 -- start start 2024-08-17T02:27:48.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 0x7f5830152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583016a0f0 con 0x7f5830158cb0 2024-08-17T02:27:48.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300991a0 con 0x7f58300af6d0 2024-08-17T02:27:48.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.224+0000 7f5835600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830098590 con 0x7f58300ac820 2024-08-17T02:27:48.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40922/0 (socket says 172.21.15.46:40922) 2024-08-17T02:27:48.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 -- 172.21.15.46:0/1013359516 learned_addr learned my addr 172.21.15.46:0/1013359516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:48.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 -- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 msgr2=0x7f5830169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582e000640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 0x7f5830152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582ea00640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 -- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 msgr2=0x7f5830152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 0x7f5830152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 -- 172.21.15.46:0/1013359516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009450 con 0x7f5830158cb0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582e000640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 0x7f5830152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582ea00640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f582f400640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5828009e90 tx=0x7f582800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582800ce10 con 0x7f5830158cb0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582800f040 con 0x7f5830158cb0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280146d0 con 0x7f5830158cb0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.225+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5830098870 con 0x7f5830158cb0 2024-08-17T02:27:48.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.226+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5830098e30 con 0x7f5830158cb0 2024-08-17T02:27:48.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.227+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5830099330 con 0x7f5830158cb0 2024-08-17T02:27:48.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.228+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5828014a80 con 0x7f5830158cb0 2024-08-17T02:27:48.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.229+0000 7f5826000640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 0x7f5810067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.229+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f58280830e0 con 0x7f5830158cb0 2024-08-17T02:27:48.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.229+0000 7f582ea00640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 0x7f5810067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.230+0000 7f582ea00640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 0x7f5810067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5820001670 tx=0x7f5820009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.233+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5828054b90 con 0x7f5830158cb0 2024-08-17T02:27:48.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.411+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5830064db0 con 0x7f5810065150 2024-08-17T02:27:48.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.418+0000 7f5826000640 1 -- 172.21.15.46:0/1013359516 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264570 (secure 0 0 0) 0x7f5830064db0 con 0x7f5810065150 2024-08-17T02:27:48.421 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:48.422 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 msgr2=0x7f5810067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 0x7f5810067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5820001670 tx=0x7f5820009040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 msgr2=0x7f5830099630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5828009e90 tx=0x7f582800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 shutdown_connections 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5830158cb0 0x7f5830099630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58300af6d0 0x7f5830152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5810065150 0x7f5810067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 --2- 172.21.15.46:0/1013359516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58300ac820 0x7f5830169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 >> 172.21.15.46:0/1013359516 conn(0x7f5830096a70 msgr2=0x7f583006a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 shutdown_connections 2024-08-17T02:27:48.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.422+0000 7f5835600640 1 -- 172.21.15.46:0/1013359516 wait complete. 2024-08-17T02:27:48.436 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:47.013551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398768,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575952,"statfs":{"total":773094113280,"available":770637774848,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.081706"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962517+0000","last_change":"2024-08-17T02:27:38.958278+0000","last_active":"2024-08-17T02:27:38.962517+0000","last_peered":"2024-08-17T02:27:38.962517+0000","last_clean":"2024-08-17T02:27:38.962517+0000","last_became_active":"2024-08-17T02:27:38.957984+0000","last_became_peered":"2024-08-17T02:27:38.957984+0000","last_unstale":"2024-08-17T02:27:38.962517+0000","last_undegraded":"2024-08-17T02:27:38.962517+0000","last_fullsized":"2024-08-17T02:27:38.962517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.946817+0000","last_change":"2024-08-17T02:27:38.944267+0000","last_active":"2024-08-17T02:27:38.946817+0000","last_peered":"2024-08-17T02:27:38.946817+0000","last_clean":"2024-08-17T02:27:38.946817+0000","last_became_active":"2024-08-17T02:27:38.944006+0000","last_became_peered":"2024-08-17T02:27:38.944006+0000","last_unstale":"2024-08-17T02:27:38.946817+0000","last_undegraded":"2024-08-17T02:27:38.946817+0000","last_fullsized":"2024-08-17T02:27:38.946817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944649+0000","last_change":"2024-08-17T02:27:38.942978+0000","last_active":"2024-08-17T02:27:38.944649+0000","last_peered":"2024-08-17T02:27:38.944649+0000","last_clean":"2024-08-17T02:27:38.944649+0000","last_became_active":"2024-08-17T02:27:38.942718+0000","last_became_peered":"2024-08-17T02:27:38.942718+0000","last_unstale":"2024-08-17T02:27:38.944649+0000","last_undegraded":"2024-08-17T02:27:38.944649+0000","last_fullsized":"2024-08-17T02:27:38.944649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962421+0000","last_change":"2024-08-17T02:27:38.952449+0000","last_active":"2024-08-17T02:27:38.962421+0000","last_peered":"2024-08-17T02:27:38.962421+0000","last_clean":"2024-08-17T02:27:38.962421+0000","last_became_active":"2024-08-17T02:27:38.951835+0000","last_became_peered":"2024-08-17T02:27:38.951835+0000","last_unstale":"2024-08-17T02:27:38.962421+0000","last_undegraded":"2024-08-17T02:27:38.962421+0000","last_fullsized":"2024-08-17T02:27:38.962421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959709+0000","last_change":"2024-08-17T02:27:38.955373+0000","last_active":"2024-08-17T02:27:38.959709+0000","last_peered":"2024-08-17T02:27:38.959709+0000","last_clean":"2024-08-17T02:27:38.959709+0000","last_became_active":"2024-08-17T02:27:38.955029+0000","last_became_peered":"2024-08-17T02:27:38.955029+0000","last_unstale":"2024-08-17T02:27:38.959709+0000","last_undegraded":"2024-08-17T02:27:38.959709+0000","last_fullsized":"2024-08-17T02:27:38.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.947951+0000","last_change":"2024-08-17T02:27:38.942516+0000","last_active":"2024-08-17T02:27:38.947951+0000","last_peered":"2024-08-17T02:27:38.947951+0000","last_clean":"2024-08-17T02:27:38.947951+0000","last_became_active":"2024-08-17T02:27:38.942194+0000","last_became_peered":"2024-08-17T02:27:38.942194+0000","last_unstale":"2024-08-17T02:27:38.947951+0000","last_undegraded":"2024-08-17T02:27:38.947951+0000","last_fullsized":"2024-08-17T02:27:38.947951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960316+0000","last_change":"2024-08-17T02:27:38.946154+0000","last_active":"2024-08-17T02:27:38.960316+0000","last_peered":"2024-08-17T02:27:38.960316+0000","last_clean":"2024-08-17T02:27:38.960316+0000","last_became_active":"2024-08-17T02:27:38.945737+0000","last_became_peered":"2024-08-17T02:27:38.945737+0000","last_unstale":"2024-08-17T02:27:38.960316+0000","last_undegraded":"2024-08-17T02:27:38.960316+0000","last_fullsized":"2024-08-17T02:27:38.960316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.956360+0000","last_change":"2024-08-17T02:27:38.955006+0000","last_active":"2024-08-17T02:27:38.956360+0000","last_peered":"2024-08-17T02:27:38.956360+0000","last_clean":"2024-08-17T02:27:38.956360+0000","last_became_active":"2024-08-17T02:27:38.954720+0000","last_became_peered":"2024-08-17T02:27:38.954720+0000","last_unstale":"2024-08-17T02:27:38.956360+0000","last_undegraded":"2024-08-17T02:27:38.956360+0000","last_fullsized":"2024-08-17T02:27:38.956360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966232+0000","last_change":"2024-08-17T02:27:38.964613+0000","last_active":"2024-08-17T02:27:38.966232+0000","last_peered":"2024-08-17T02:27:38.966232+0000","last_clean":"2024-08-17T02:27:38.966232+0000","last_became_active":"2024-08-17T02:27:38.964331+0000","last_became_peered":"2024-08-17T02:27:38.964331+0000","last_unstale":"2024-08-17T02:27:38.966232+0000","last_undegraded":"2024-08-17T02:27:38.966232+0000","last_fullsized":"2024-08-17T02:27:38.966232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:44.158845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954749+0000","last_change":"2024-08-17T02:27:38.952858+0000","last_active":"2024-08-17T02:27:38.954749+0000","last_peered":"2024-08-17T02:27:38.954749+0000","last_clean":"2024-08-17T02:27:38.954749+0000","last_became_active":"2024-08-17T02:27:38.951695+0000","last_became_peered":"2024-08-17T02:27:38.951695+0000","last_unstale":"2024-08-17T02:27:38.954749+0000","last_undegraded":"2024-08-17T02:27:38.954749+0000","last_fullsized":"2024-08-17T02:27:38.954749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952093+0000","last_change":"2024-08-17T02:27:38.949326+0000","last_active":"2024-08-17T02:27:38.952093+0000","last_peered":"2024-08-17T02:27:38.952093+0000","last_clean":"2024-08-17T02:27:38.952093+0000","last_became_active":"2024-08-17T02:27:38.948495+0000","last_became_peered":"2024-08-17T02:27:38.948495+0000","last_unstale":"2024-08-17T02:27:38.952093+0000","last_undegraded":"2024-08-17T02:27:38.952093+0000","last_fullsized":"2024-08-17T02:27:38.952093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962468+0000","last_change":"2024-08-17T02:27:38.957539+0000","last_active":"2024-08-17T02:27:38.962468+0000","last_peered":"2024-08-17T02:27:38.962468+0000","last_clean":"2024-08-17T02:27:38.962468+0000","last_became_active":"2024-08-17T02:27:38.957141+0000","last_became_peered":"2024-08-17T02:27:38.957141+0000","last_unstale":"2024-08-17T02:27:38.962468+0000","last_undegraded":"2024-08-17T02:27:38.962468+0000","last_fullsized":"2024-08-17T02:27:38.962468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953273+0000","last_change":"2024-08-17T02:27:38.951276+0000","last_active":"2024-08-17T02:27:38.953273+0000","last_peered":"2024-08-17T02:27:38.953273+0000","last_clean":"2024-08-17T02:27:38.953273+0000","last_became_active":"2024-08-17T02:27:38.951019+0000","last_became_peered":"2024-08-17T02:27:38.951019+0000","last_unstale":"2024-08-17T02:27:38.953273+0000","last_undegraded":"2024-08-17T02:27:38.953273+0000","last_fullsized":"2024-08-17T02:27:38.953273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945764+0000","last_change":"2024-08-17T02:27:38.944212+0000","last_active":"2024-08-17T02:27:38.945764+0000","last_peered":"2024-08-17T02:27:38.945764+0000","last_clean":"2024-08-17T02:27:38.945764+0000","last_became_active":"2024-08-17T02:27:38.943893+0000","last_became_peered":"2024-08-17T02:27:38.943893+0000","last_unstale":"2024-08-17T02:27:38.945764+0000","last_undegraded":"2024-08-17T02:27:38.945764+0000","last_fullsized":"2024-08-17T02:27:38.945764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964237+0000","last_change":"2024-08-17T02:27:38.963326+0000","last_active":"2024-08-17T02:27:38.964237+0000","last_peered":"2024-08-17T02:27:38.964237+0000","last_clean":"2024-08-17T02:27:38.964237+0000","last_became_active":"2024-08-17T02:27:38.963045+0000","last_became_peered":"2024-08-17T02:27:38.963045+0000","last_unstale":"2024-08-17T02:27:38.964237+0000","last_undegraded":"2024-08-17T02:27:38.964237+0000","last_fullsized":"2024-08-17T02:27:38.964237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945157+0000","last_change":"2024-08-17T02:27:38.942730+0000","last_active":"2024-08-17T02:27:38.945157+0000","last_peered":"2024-08-17T02:27:38.945157+0000","last_clean":"2024-08-17T02:27:38.945157+0000","last_became_active":"2024-08-17T02:27:38.942318+0000","last_became_peered":"2024-08-17T02:27:38.942318+0000","last_unstale":"2024-08-17T02:27:38.945157+0000","last_undegraded":"2024-08-17T02:27:38.945157+0000","last_fullsized":"2024-08-17T02:27:38.945157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965284+0000","last_change":"2024-08-17T02:27:38.957401+0000","last_active":"2024-08-17T02:27:38.965284+0000","last_peered":"2024-08-17T02:27:38.965284+0000","last_clean":"2024-08-17T02:27:38.965284+0000","last_became_active":"2024-08-17T02:27:38.956806+0000","last_became_peered":"2024-08-17T02:27:38.956806+0000","last_unstale":"2024-08-17T02:27:38.965284+0000","last_undegraded":"2024-08-17T02:27:38.965284+0000","last_fullsized":"2024-08-17T02:27:38.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951390+0000","last_change":"2024-08-17T02:27:38.948303+0000","last_active":"2024-08-17T02:27:38.951390+0000","last_peered":"2024-08-17T02:27:38.951390+0000","last_clean":"2024-08-17T02:27:38.951390+0000","last_became_active":"2024-08-17T02:27:38.948045+0000","last_became_peered":"2024-08-17T02:27:38.948045+0000","last_unstale":"2024-08-17T02:27:38.951390+0000","last_undegraded":"2024-08-17T02:27:38.951390+0000","last_fullsized":"2024-08-17T02:27:38.951390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957615+0000","last_change":"2024-08-17T02:27:38.955302+0000","last_active":"2024-08-17T02:27:38.957615+0000","last_peered":"2024-08-17T02:27:38.957615+0000","last_clean":"2024-08-17T02:27:38.957615+0000","last_became_active":"2024-08-17T02:27:38.955011+0000","last_became_peered":"2024-08-17T02:27:38.955011+0000","last_unstale":"2024-08-17T02:27:38.957615+0000","last_undegraded":"2024-08-17T02:27:38.957615+0000","last_fullsized":"2024-08-17T02:27:38.957615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965503+0000","last_change":"2024-08-17T02:27:38.962208+0000","last_active":"2024-08-17T02:27:38.965503+0000","last_peered":"2024-08-17T02:27:38.965503+0000","last_clean":"2024-08-17T02:27:38.965503+0000","last_became_active":"2024-08-17T02:27:38.961860+0000","last_became_peered":"2024-08-17T02:27:38.961860+0000","last_unstale":"2024-08-17T02:27:38.965503+0000","last_undegraded":"2024-08-17T02:27:38.965503+0000","last_fullsized":"2024-08-17T02:27:38.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961179+0000","last_change":"2024-08-17T02:27:38.960549+0000","last_active":"2024-08-17T02:27:38.961179+0000","last_peered":"2024-08-17T02:27:38.961179+0000","last_clean":"2024-08-17T02:27:38.961179+0000","last_became_active":"2024-08-17T02:27:38.960365+0000","last_became_peered":"2024-08-17T02:27:38.960365+0000","last_unstale":"2024-08-17T02:27:38.961179+0000","last_undegraded":"2024-08-17T02:27:38.961179+0000","last_fullsized":"2024-08-17T02:27:38.961179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962883+0000","last_change":"2024-08-17T02:27:38.956102+0000","last_active":"2024-08-17T02:27:38.962883+0000","last_peered":"2024-08-17T02:27:38.962883+0000","last_clean":"2024-08-17T02:27:38.962883+0000","last_became_active":"2024-08-17T02:27:38.955662+0000","last_became_peered":"2024-08-17T02:27:38.955662+0000","last_unstale":"2024-08-17T02:27:38.962883+0000","last_undegraded":"2024-08-17T02:27:38.962883+0000","last_fullsized":"2024-08-17T02:27:38.962883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963896+0000","last_change":"2024-08-17T02:27:38.963135+0000","last_active":"2024-08-17T02:27:38.963896+0000","last_peered":"2024-08-17T02:27:38.963896+0000","last_clean":"2024-08-17T02:27:38.963896+0000","last_became_active":"2024-08-17T02:27:38.962870+0000","last_became_peered":"2024-08-17T02:27:38.962870+0000","last_unstale":"2024-08-17T02:27:38.963896+0000","last_undegraded":"2024-08-17T02:27:38.963896+0000","last_fullsized":"2024-08-17T02:27:38.963896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962232+0000","last_change":"2024-08-17T02:27:38.954011+0000","last_active":"2024-08-17T02:27:38.962232+0000","last_peered":"2024-08-17T02:27:38.962232+0000","last_clean":"2024-08-17T02:27:38.962232+0000","last_became_active":"2024-08-17T02:27:38.950742+0000","last_became_peered":"2024-08-17T02:27:38.950742+0000","last_unstale":"2024-08-17T02:27:38.962232+0000","last_undegraded":"2024-08-17T02:27:38.962232+0000","last_fullsized":"2024-08-17T02:27:38.962232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957913+0000","last_change":"2024-08-17T02:27:38.956849+0000","last_active":"2024-08-17T02:27:38.957913+0000","last_peered":"2024-08-17T02:27:38.957913+0000","last_clean":"2024-08-17T02:27:38.957913+0000","last_became_active":"2024-08-17T02:27:38.956343+0000","last_became_peered":"2024-08-17T02:27:38.956343+0000","last_unstale":"2024-08-17T02:27:38.957913+0000","last_undegraded":"2024-08-17T02:27:38.957913+0000","last_fullsized":"2024-08-17T02:27:38.957913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966173+0000","last_change":"2024-08-17T02:27:38.964205+0000","last_active":"2024-08-17T02:27:38.966173+0000","last_peered":"2024-08-17T02:27:38.966173+0000","last_clean":"2024-08-17T02:27:38.966173+0000","last_became_active":"2024-08-17T02:27:38.963917+0000","last_became_peered":"2024-08-17T02:27:38.963917+0000","last_unstale":"2024-08-17T02:27:38.966173+0000","last_undegraded":"2024-08-17T02:27:38.966173+0000","last_fullsized":"2024-08-17T02:27:38.966173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953689+0000","last_change":"2024-08-17T02:27:38.952501+0000","last_active":"2024-08-17T02:27:38.953689+0000","last_peered":"2024-08-17T02:27:38.953689+0000","last_clean":"2024-08-17T02:27:38.953689+0000","last_became_active":"2024-08-17T02:27:38.952172+0000","last_became_peered":"2024-08-17T02:27:38.952172+0000","last_unstale":"2024-08-17T02:27:38.953689+0000","last_undegraded":"2024-08-17T02:27:38.953689+0000","last_fullsized":"2024-08-17T02:27:38.953689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957901+0000","last_change":"2024-08-17T02:27:38.956673+0000","last_active":"2024-08-17T02:27:38.957901+0000","last_peered":"2024-08-17T02:27:38.957901+0000","last_clean":"2024-08-17T02:27:38.957901+0000","last_became_active":"2024-08-17T02:27:38.956396+0000","last_became_peered":"2024-08-17T02:27:38.956396+0000","last_unstale":"2024-08-17T02:27:38.957901+0000","last_undegraded":"2024-08-17T02:27:38.957901+0000","last_fullsized":"2024-08-17T02:27:38.957901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953576+0000","last_change":"2024-08-17T02:27:38.952052+0000","last_active":"2024-08-17T02:27:38.953576+0000","last_peered":"2024-08-17T02:27:38.953576+0000","last_clean":"2024-08-17T02:27:38.953576+0000","last_became_active":"2024-08-17T02:27:38.951782+0000","last_became_peered":"2024-08-17T02:27:38.951782+0000","last_unstale":"2024-08-17T02:27:38.953576+0000","last_undegraded":"2024-08-17T02:27:38.953576+0000","last_fullsized":"2024-08-17T02:27:38.953576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962863+0000","last_change":"2024-08-17T02:27:38.951396+0000","last_active":"2024-08-17T02:27:38.962863+0000","last_peered":"2024-08-17T02:27:38.962863+0000","last_clean":"2024-08-17T02:27:38.962863+0000","last_became_active":"2024-08-17T02:27:38.950821+0000","last_became_peered":"2024-08-17T02:27:38.950821+0000","last_unstale":"2024-08-17T02:27:38.962863+0000","last_undegraded":"2024-08-17T02:27:38.962863+0000","last_fullsized":"2024-08-17T02:27:38.962863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944409+0000","last_change":"2024-08-17T02:27:38.942963+0000","last_active":"2024-08-17T02:27:38.944409+0000","last_peered":"2024-08-17T02:27:38.944409+0000","last_clean":"2024-08-17T02:27:38.944409+0000","last_became_active":"2024-08-17T02:27:38.942517+0000","last_became_peered":"2024-08-17T02:27:38.942517+0000","last_unstale":"2024-08-17T02:27:38.944409+0000","last_undegraded":"2024-08-17T02:27:38.944409+0000","last_fullsized":"2024-08-17T02:27:38.944409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.948174+0000","last_change":"2024-08-17T02:27:38.945072+0000","last_active":"2024-08-17T02:27:38.948174+0000","last_peered":"2024-08-17T02:27:38.948174+0000","last_clean":"2024-08-17T02:27:38.948174+0000","last_became_active":"2024-08-17T02:27:38.944747+0000","last_became_peered":"2024-08-17T02:27:38.944747+0000","last_unstale":"2024-08-17T02:27:38.948174+0000","last_undegraded":"2024-08-17T02:27:38.948174+0000","last_fullsized":"2024-08-17T02:27:38.948174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960742+0000","last_change":"2024-08-17T02:27:38.954890+0000","last_active":"2024-08-17T02:27:38.960742+0000","last_peered":"2024-08-17T02:27:38.960742+0000","last_clean":"2024-08-17T02:27:38.960742+0000","last_became_active":"2024-08-17T02:27:38.954069+0000","last_became_peered":"2024-08-17T02:27:38.954069+0000","last_unstale":"2024-08-17T02:27:38.960742+0000","last_undegraded":"2024-08-17T02:27:38.960742+0000","last_fullsized":"2024-08-17T02:27:38.960742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220847+0000","last_change":"2024-08-17T02:27:38.231207+0000","last_active":"2024-08-17T02:27:39.220847+0000","last_peered":"2024-08-17T02:27:39.220847+0000","last_clean":"2024-08-17T02:27:39.220847+0000","last_became_active":"2024-08-17T02:27:38.230920+0000","last_became_peered":"2024-08-17T02:27:38.230920+0000","last_unstale":"2024-08-17T02:27:39.220847+0000","last_undegraded":"2024-08-17T02:27:39.220847+0000","last_fullsized":"2024-08-17T02:27:39.220847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959071+0000","last_change":"2024-08-17T02:27:38.958530+0000","last_active":"2024-08-17T02:27:38.959071+0000","last_peered":"2024-08-17T02:27:38.959071+0000","last_clean":"2024-08-17T02:27:38.959071+0000","last_became_active":"2024-08-17T02:27:38.958248+0000","last_became_peered":"2024-08-17T02:27:38.958248+0000","last_unstale":"2024-08-17T02:27:38.959071+0000","last_undegraded":"2024-08-17T02:27:38.959071+0000","last_fullsized":"2024-08-17T02:27:38.959071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:03.268893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220075+0000","last_change":"2024-08-17T02:27:38.230888+0000","last_active":"2024-08-17T02:27:39.220075+0000","last_peered":"2024-08-17T02:27:39.220075+0000","last_clean":"2024-08-17T02:27:39.220075+0000","last_became_active":"2024-08-17T02:27:38.230628+0000","last_became_peered":"2024-08-17T02:27:38.230628+0000","last_unstale":"2024-08-17T02:27:39.220075+0000","last_undegraded":"2024-08-17T02:27:39.220075+0000","last_fullsized":"2024-08-17T02:27:39.220075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945305+0000","last_change":"2024-08-17T02:27:38.232578+0000","last_active":"2024-08-17T02:27:38.945305+0000","last_peered":"2024-08-17T02:27:38.945305+0000","last_clean":"2024-08-17T02:27:38.945305+0000","last_became_active":"2024-08-17T02:27:38.232328+0000","last_became_peered":"2024-08-17T02:27:38.232328+0000","last_unstale":"2024-08-17T02:27:38.945305+0000","last_undegraded":"2024-08-17T02:27:38.945305+0000","last_fullsized":"2024-08-17T02:27:38.945305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952818+0000","last_change":"2024-08-17T02:27:38.949107+0000","last_active":"2024-08-17T02:27:38.952818+0000","last_peered":"2024-08-17T02:27:38.952818+0000","last_clean":"2024-08-17T02:27:38.952818+0000","last_became_active":"2024-08-17T02:27:38.948752+0000","last_became_peered":"2024-08-17T02:27:38.948752+0000","last_unstale":"2024-08-17T02:27:38.952818+0000","last_undegraded":"2024-08-17T02:27:38.952818+0000","last_fullsized":"2024-08-17T02:27:38.952818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935357+0000","last_change":"2024-08-17T02:27:38.231349+0000","last_active":"2024-08-17T02:27:38.935357+0000","last_peered":"2024-08-17T02:27:38.935357+0000","last_clean":"2024-08-17T02:27:38.935357+0000","last_became_active":"2024-08-17T02:27:38.229006+0000","last_became_peered":"2024-08-17T02:27:38.229006+0000","last_unstale":"2024-08-17T02:27:38.935357+0000","last_undegraded":"2024-08-17T02:27:38.935357+0000","last_fullsized":"2024-08-17T02:27:38.935357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950543+0000","last_change":"2024-08-17T02:27:38.947300+0000","last_active":"2024-08-17T02:27:38.950543+0000","last_peered":"2024-08-17T02:27:38.950543+0000","last_clean":"2024-08-17T02:27:38.950543+0000","last_became_active":"2024-08-17T02:27:38.947059+0000","last_became_peered":"2024-08-17T02:27:38.947059+0000","last_unstale":"2024-08-17T02:27:38.950543+0000","last_undegraded":"2024-08-17T02:27:38.950543+0000","last_fullsized":"2024-08-17T02:27:38.950543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940920+0000","last_change":"2024-08-17T02:27:38.232144+0000","last_active":"2024-08-17T02:27:38.940920+0000","last_peered":"2024-08-17T02:27:38.940920+0000","last_clean":"2024-08-17T02:27:38.940920+0000","last_became_active":"2024-08-17T02:27:38.231898+0000","last_became_peered":"2024-08-17T02:27:38.231898+0000","last_unstale":"2024-08-17T02:27:38.940920+0000","last_undegraded":"2024-08-17T02:27:38.940920+0000","last_fullsized":"2024-08-17T02:27:38.940920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963050+0000","last_change":"2024-08-17T02:27:38.956085+0000","last_active":"2024-08-17T02:27:38.963050+0000","last_peered":"2024-08-17T02:27:38.963050+0000","last_clean":"2024-08-17T02:27:38.963050+0000","last_became_active":"2024-08-17T02:27:38.955751+0000","last_became_peered":"2024-08-17T02:27:38.955751+0000","last_unstale":"2024-08-17T02:27:38.963050+0000","last_undegraded":"2024-08-17T02:27:38.963050+0000","last_fullsized":"2024-08-17T02:27:38.963050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936075+0000","last_change":"2024-08-17T02:27:38.232861+0000","last_active":"2024-08-17T02:27:38.936075+0000","last_peered":"2024-08-17T02:27:38.936075+0000","last_clean":"2024-08-17T02:27:38.936075+0000","last_became_active":"2024-08-17T02:27:38.232502+0000","last_became_peered":"2024-08-17T02:27:38.232502+0000","last_unstale":"2024-08-17T02:27:38.936075+0000","last_undegraded":"2024-08-17T02:27:38.936075+0000","last_fullsized":"2024-08-17T02:27:38.936075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953569+0000","last_change":"2024-08-17T02:27:38.951604+0000","last_active":"2024-08-17T02:27:38.953569+0000","last_peered":"2024-08-17T02:27:38.953569+0000","last_clean":"2024-08-17T02:27:38.953569+0000","last_became_active":"2024-08-17T02:27:38.950994+0000","last_became_peered":"2024-08-17T02:27:38.950994+0000","last_unstale":"2024-08-17T02:27:38.953569+0000","last_undegraded":"2024-08-17T02:27:38.953569+0000","last_fullsized":"2024-08-17T02:27:38.953569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:00.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222887+0000","last_change":"2024-08-17T02:27:38.236164+0000","last_active":"2024-08-17T02:27:39.222887+0000","last_peered":"2024-08-17T02:27:39.222887+0000","last_clean":"2024-08-17T02:27:39.222887+0000","last_became_active":"2024-08-17T02:27:38.235615+0000","last_became_peered":"2024-08-17T02:27:38.235615+0000","last_unstale":"2024-08-17T02:27:39.222887+0000","last_undegraded":"2024-08-17T02:27:39.222887+0000","last_fullsized":"2024-08-17T02:27:39.222887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965382+0000","last_change":"2024-08-17T02:27:38.962949+0000","last_active":"2024-08-17T02:27:38.965382+0000","last_peered":"2024-08-17T02:27:38.965382+0000","last_clean":"2024-08-17T02:27:38.965382+0000","last_became_active":"2024-08-17T02:27:38.960473+0000","last_became_peered":"2024-08-17T02:27:38.960473+0000","last_unstale":"2024-08-17T02:27:38.965382+0000","last_undegraded":"2024-08-17T02:27:38.965382+0000","last_fullsized":"2024-08-17T02:27:38.965382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:02.910612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.223251+0000","last_change":"2024-08-17T02:27:38.239544+0000","last_active":"2024-08-17T02:27:39.223251+0000","last_peered":"2024-08-17T02:27:39.223251+0000","last_clean":"2024-08-17T02:27:39.223251+0000","last_became_active":"2024-08-17T02:27:38.239105+0000","last_became_peered":"2024-08-17T02:27:38.239105+0000","last_unstale":"2024-08-17T02:27:39.223251+0000","last_undegraded":"2024-08-17T02:27:39.223251+0000","last_fullsized":"2024-08-17T02:27:39.223251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963452+0000","last_change":"2024-08-17T02:27:38.959403+0000","last_active":"2024-08-17T02:27:38.963452+0000","last_peered":"2024-08-17T02:27:38.963452+0000","last_clean":"2024-08-17T02:27:38.963452+0000","last_became_active":"2024-08-17T02:27:38.959187+0000","last_became_peered":"2024-08-17T02:27:38.959187+0000","last_unstale":"2024-08-17T02:27:38.963452+0000","last_undegraded":"2024-08-17T02:27:38.963452+0000","last_fullsized":"2024-08-17T02:27:38.963452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220958+0000","last_change":"2024-08-17T02:27:38.231982+0000","last_active":"2024-08-17T02:27:39.220958+0000","last_peered":"2024-08-17T02:27:39.220958+0000","last_clean":"2024-08-17T02:27:39.220958+0000","last_became_active":"2024-08-17T02:27:38.231721+0000","last_became_peered":"2024-08-17T02:27:38.231721+0000","last_unstale":"2024-08-17T02:27:39.220958+0000","last_undegraded":"2024-08-17T02:27:39.220958+0000","last_fullsized":"2024-08-17T02:27:39.220958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953724+0000","last_change":"2024-08-17T02:27:38.951652+0000","last_active":"2024-08-17T02:27:38.953724+0000","last_peered":"2024-08-17T02:27:38.953724+0000","last_clean":"2024-08-17T02:27:38.953724+0000","last_became_active":"2024-08-17T02:27:38.951389+0000","last_became_peered":"2024-08-17T02:27:38.951389+0000","last_unstale":"2024-08-17T02:27:38.953724+0000","last_undegraded":"2024-08-17T02:27:38.953724+0000","last_fullsized":"2024-08-17T02:27:38.953724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936958+0000","last_change":"2024-08-17T02:27:38.232932+0000","last_active":"2024-08-17T02:27:38.936958+0000","last_peered":"2024-08-17T02:27:38.936958+0000","last_clean":"2024-08-17T02:27:38.936958+0000","last_became_active":"2024-08-17T02:27:38.232660+0000","last_became_peered":"2024-08-17T02:27:38.232660+0000","last_unstale":"2024-08-17T02:27:38.936958+0000","last_undegraded":"2024-08-17T02:27:38.936958+0000","last_fullsized":"2024-08-17T02:27:38.936958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963894+0000","last_change":"2024-08-17T02:27:38.959826+0000","last_active":"2024-08-17T02:27:38.963894+0000","last_peered":"2024-08-17T02:27:38.963894+0000","last_clean":"2024-08-17T02:27:38.963894+0000","last_became_active":"2024-08-17T02:27:38.959504+0000","last_became_peered":"2024-08-17T02:27:38.959504+0000","last_unstale":"2024-08-17T02:27:38.963894+0000","last_undegraded":"2024-08-17T02:27:38.963894+0000","last_fullsized":"2024-08-17T02:27:38.963894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940921+0000","last_change":"2024-08-17T02:27:38.228984+0000","last_active":"2024-08-17T02:27:38.940921+0000","last_peered":"2024-08-17T02:27:38.940921+0000","last_clean":"2024-08-17T02:27:38.940921+0000","last_became_active":"2024-08-17T02:27:38.228654+0000","last_became_peered":"2024-08-17T02:27:38.228654+0000","last_unstale":"2024-08-17T02:27:38.940921+0000","last_undegraded":"2024-08-17T02:27:38.940921+0000","last_fullsized":"2024-08-17T02:27:38.940921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952020+0000","last_change":"2024-08-17T02:27:38.949332+0000","last_active":"2024-08-17T02:27:38.952020+0000","last_peered":"2024-08-17T02:27:38.952020+0000","last_clean":"2024-08-17T02:27:38.952020+0000","last_became_active":"2024-08-17T02:27:38.948725+0000","last_became_peered":"2024-08-17T02:27:38.948725+0000","last_unstale":"2024-08-17T02:27:38.952020+0000","last_undegraded":"2024-08-17T02:27:38.952020+0000","last_fullsized":"2024-08-17T02:27:38.952020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221358+0000","last_change":"2024-08-17T02:27:38.234103+0000","last_active":"2024-08-17T02:27:39.221358+0000","last_peered":"2024-08-17T02:27:39.221358+0000","last_clean":"2024-08-17T02:27:39.221358+0000","last_became_active":"2024-08-17T02:27:38.233720+0000","last_became_peered":"2024-08-17T02:27:38.233720+0000","last_unstale":"2024-08-17T02:27:39.221358+0000","last_undegraded":"2024-08-17T02:27:39.221358+0000","last_fullsized":"2024-08-17T02:27:39.221358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964797+0000","last_change":"2024-08-17T02:27:38.960907+0000","last_active":"2024-08-17T02:27:38.964797+0000","last_peered":"2024-08-17T02:27:38.964797+0000","last_clean":"2024-08-17T02:27:38.964797+0000","last_became_active":"2024-08-17T02:27:38.960512+0000","last_became_peered":"2024-08-17T02:27:38.960512+0000","last_unstale":"2024-08-17T02:27:38.964797+0000","last_undegraded":"2024-08-17T02:27:38.964797+0000","last_fullsized":"2024-08-17T02:27:38.964797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220665+0000","last_change":"2024-08-17T02:27:38.230338+0000","last_active":"2024-08-17T02:27:39.220665+0000","last_peered":"2024-08-17T02:27:39.220665+0000","last_clean":"2024-08-17T02:27:39.220665+0000","last_became_active":"2024-08-17T02:27:38.229932+0000","last_became_peered":"2024-08-17T02:27:38.229932+0000","last_unstale":"2024-08-17T02:27:39.220665+0000","last_undegraded":"2024-08-17T02:27:39.220665+0000","last_fullsized":"2024-08-17T02:27:39.220665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966062+0000","last_change":"2024-08-17T02:27:38.964572+0000","last_active":"2024-08-17T02:27:38.966062+0000","last_peered":"2024-08-17T02:27:38.966062+0000","last_clean":"2024-08-17T02:27:38.966062+0000","last_became_active":"2024-08-17T02:27:38.964171+0000","last_became_peered":"2024-08-17T02:27:38.964171+0000","last_unstale":"2024-08-17T02:27:38.966062+0000","last_undegraded":"2024-08-17T02:27:38.966062+0000","last_fullsized":"2024-08-17T02:27:38.966062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221364+0000","last_change":"2024-08-17T02:27:38.231746+0000","last_active":"2024-08-17T02:27:39.221364+0000","last_peered":"2024-08-17T02:27:39.221364+0000","last_clean":"2024-08-17T02:27:39.221364+0000","last_became_active":"2024-08-17T02:27:38.231403+0000","last_became_peered":"2024-08-17T02:27:38.231403+0000","last_unstale":"2024-08-17T02:27:39.221364+0000","last_undegraded":"2024-08-17T02:27:39.221364+0000","last_fullsized":"2024-08-17T02:27:39.221364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966830+0000","last_change":"2024-08-17T02:27:38.965438+0000","last_active":"2024-08-17T02:27:38.966830+0000","last_peered":"2024-08-17T02:27:38.966830+0000","last_clean":"2024-08-17T02:27:38.966830+0000","last_became_active":"2024-08-17T02:27:38.964623+0000","last_became_peered":"2024-08-17T02:27:38.964623+0000","last_unstale":"2024-08-17T02:27:38.966830+0000","last_undegraded":"2024-08-17T02:27:38.966830+0000","last_fullsized":"2024-08-17T02:27:38.966830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222595+0000","last_change":"2024-08-17T02:27:38.235902+0000","last_active":"2024-08-17T02:27:39.222595+0000","last_peered":"2024-08-17T02:27:39.222595+0000","last_clean":"2024-08-17T02:27:39.222595+0000","last_became_active":"2024-08-17T02:27:38.235584+0000","last_became_peered":"2024-08-17T02:27:38.235584+0000","last_unstale":"2024-08-17T02:27:39.222595+0000","last_undegraded":"2024-08-17T02:27:39.222595+0000","last_fullsized":"2024-08-17T02:27:39.222595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962432+0000","last_change":"2024-08-17T02:27:38.952664+0000","last_active":"2024-08-17T02:27:38.962432+0000","last_peered":"2024-08-17T02:27:38.962432+0000","last_clean":"2024-08-17T02:27:38.962432+0000","last_became_active":"2024-08-17T02:27:38.952205+0000","last_became_peered":"2024-08-17T02:27:38.952205+0000","last_unstale":"2024-08-17T02:27:38.962432+0000","last_undegraded":"2024-08-17T02:27:38.962432+0000","last_fullsized":"2024-08-17T02:27:38.962432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935719+0000","last_change":"2024-08-17T02:27:38.231965+0000","last_active":"2024-08-17T02:27:38.935719+0000","last_peered":"2024-08-17T02:27:38.935719+0000","last_clean":"2024-08-17T02:27:38.935719+0000","last_became_active":"2024-08-17T02:27:38.231608+0000","last_became_peered":"2024-08-17T02:27:38.231608+0000","last_unstale":"2024-08-17T02:27:38.935719+0000","last_undegraded":"2024-08-17T02:27:38.935719+0000","last_fullsized":"2024-08-17T02:27:38.935719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960138+0000","last_change":"2024-08-17T02:27:38.957545+0000","last_active":"2024-08-17T02:27:38.960138+0000","last_peered":"2024-08-17T02:27:38.960138+0000","last_clean":"2024-08-17T02:27:38.960138+0000","last_became_active":"2024-08-17T02:27:38.956306+0000","last_became_peered":"2024-08-17T02:27:38.956306+0000","last_unstale":"2024-08-17T02:27:38.960138+0000","last_undegraded":"2024-08-17T02:27:38.960138+0000","last_fullsized":"2024-08-17T02:27:38.960138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937438+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:27:38.937438+0000","last_peered":"2024-08-17T02:27:38.937438+0000","last_clean":"2024-08-17T02:27:38.937438+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:27:38.937438+0000","last_undegraded":"2024-08-17T02:27:38.937438+0000","last_fullsized":"2024-08-17T02:27:38.937438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935661+0000","last_change":"2024-08-17T02:27:38.221994+0000","last_active":"2024-08-17T02:27:38.935661+0000","last_peered":"2024-08-17T02:27:38.935661+0000","last_clean":"2024-08-17T02:27:38.935661+0000","last_became_active":"2024-08-17T02:27:38.221630+0000","last_became_peered":"2024-08-17T02:27:38.221630+0000","last_unstale":"2024-08-17T02:27:38.935661+0000","last_undegraded":"2024-08-17T02:27:38.935661+0000","last_fullsized":"2024-08-17T02:27:38.935661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952005+0000","last_change":"2024-08-17T02:27:38.948764+0000","last_active":"2024-08-17T02:27:38.952005+0000","last_peered":"2024-08-17T02:27:38.952005+0000","last_clean":"2024-08-17T02:27:38.952005+0000","last_became_active":"2024-08-17T02:27:38.948461+0000","last_became_peered":"2024-08-17T02:27:38.948461+0000","last_unstale":"2024-08-17T02:27:38.952005+0000","last_undegraded":"2024-08-17T02:27:38.952005+0000","last_fullsized":"2024-08-17T02:27:38.952005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937276+0000","last_change":"2024-08-17T02:27:38.227208+0000","last_active":"2024-08-17T02:27:38.937276+0000","last_peered":"2024-08-17T02:27:38.937276+0000","last_clean":"2024-08-17T02:27:38.937276+0000","last_became_active":"2024-08-17T02:27:38.226945+0000","last_became_peered":"2024-08-17T02:27:38.226945+0000","last_unstale":"2024-08-17T02:27:38.937276+0000","last_undegraded":"2024-08-17T02:27:38.937276+0000","last_fullsized":"2024-08-17T02:27:38.937276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961809+0000","last_change":"2024-08-17T02:27:38.961180+0000","last_active":"2024-08-17T02:27:38.961809+0000","last_peered":"2024-08-17T02:27:38.961809+0000","last_clean":"2024-08-17T02:27:38.961809+0000","last_became_active":"2024-08-17T02:27:38.960913+0000","last_became_peered":"2024-08-17T02:27:38.960913+0000","last_unstale":"2024-08-17T02:27:38.961809+0000","last_undegraded":"2024-08-17T02:27:38.961809+0000","last_fullsized":"2024-08-17T02:27:38.961809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.934691+0000","last_change":"2024-08-17T02:27:38.234380+0000","last_active":"2024-08-17T02:27:38.934691+0000","last_peered":"2024-08-17T02:27:38.934691+0000","last_clean":"2024-08-17T02:27:38.934691+0000","last_became_active":"2024-08-17T02:27:38.233537+0000","last_became_peered":"2024-08-17T02:27:38.233537+0000","last_unstale":"2024-08-17T02:27:38.934691+0000","last_undegraded":"2024-08-17T02:27:38.934691+0000","last_fullsized":"2024-08-17T02:27:38.934691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943563+0000","last_change":"2024-08-17T02:27:38.940399+0000","last_active":"2024-08-17T02:27:38.943563+0000","last_peered":"2024-08-17T02:27:38.943563+0000","last_clean":"2024-08-17T02:27:38.943563+0000","last_became_active":"2024-08-17T02:27:38.939407+0000","last_became_peered":"2024-08-17T02:27:38.939407+0000","last_unstale":"2024-08-17T02:27:38.943563+0000","last_undegraded":"2024-08-17T02:27:38.943563+0000","last_fullsized":"2024-08-17T02:27:38.943563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937108+0000","last_change":"2024-08-17T02:27:38.236139+0000","last_active":"2024-08-17T02:27:38.937108+0000","last_peered":"2024-08-17T02:27:38.937108+0000","last_clean":"2024-08-17T02:27:38.937108+0000","last_became_active":"2024-08-17T02:27:38.235906+0000","last_became_peered":"2024-08-17T02:27:38.235906+0000","last_unstale":"2024-08-17T02:27:38.937108+0000","last_undegraded":"2024-08-17T02:27:38.937108+0000","last_fullsized":"2024-08-17T02:27:38.937108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961622+0000","last_change":"2024-08-17T02:27:38.955645+0000","last_active":"2024-08-17T02:27:38.961622+0000","last_peered":"2024-08-17T02:27:38.961622+0000","last_clean":"2024-08-17T02:27:38.961622+0000","last_became_active":"2024-08-17T02:27:38.955312+0000","last_became_peered":"2024-08-17T02:27:38.955312+0000","last_unstale":"2024-08-17T02:27:38.961622+0000","last_undegraded":"2024-08-17T02:27:38.961622+0000","last_fullsized":"2024-08-17T02:27:38.961622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:47.735557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932702+0000","last_change":"2024-08-17T02:27:38.237877+0000","last_active":"2024-08-17T02:27:38.932702+0000","last_peered":"2024-08-17T02:27:38.932702+0000","last_clean":"2024-08-17T02:27:38.932702+0000","last_became_active":"2024-08-17T02:27:38.237636+0000","last_became_peered":"2024-08-17T02:27:38.237636+0000","last_unstale":"2024-08-17T02:27:38.932702+0000","last_undegraded":"2024-08-17T02:27:38.932702+0000","last_fullsized":"2024-08-17T02:27:38.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954404+0000","last_change":"2024-08-17T02:27:38.950989+0000","last_active":"2024-08-17T02:27:38.954404+0000","last_peered":"2024-08-17T02:27:38.954404+0000","last_clean":"2024-08-17T02:27:38.954404+0000","last_became_active":"2024-08-17T02:27:38.950684+0000","last_became_peered":"2024-08-17T02:27:38.950684+0000","last_unstale":"2024-08-17T02:27:38.954404+0000","last_undegraded":"2024-08-17T02:27:38.954404+0000","last_fullsized":"2024-08-17T02:27:38.954404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.938295+0000","last_change":"2024-08-17T02:27:38.229546+0000","last_active":"2024-08-17T02:27:38.938295+0000","last_peered":"2024-08-17T02:27:38.938295+0000","last_clean":"2024-08-17T02:27:38.938295+0000","last_became_active":"2024-08-17T02:27:38.229068+0000","last_became_peered":"2024-08-17T02:27:38.229068+0000","last_unstale":"2024-08-17T02:27:38.938295+0000","last_undegraded":"2024-08-17T02:27:38.938295+0000","last_fullsized":"2024-08-17T02:27:38.938295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943796+0000","last_change":"2024-08-17T02:27:38.940534+0000","last_active":"2024-08-17T02:27:38.943796+0000","last_peered":"2024-08-17T02:27:38.943796+0000","last_clean":"2024-08-17T02:27:38.943796+0000","last_became_active":"2024-08-17T02:27:38.940214+0000","last_became_peered":"2024-08-17T02:27:38.940214+0000","last_unstale":"2024-08-17T02:27:38.943796+0000","last_undegraded":"2024-08-17T02:27:38.943796+0000","last_fullsized":"2024-08-17T02:27:38.943796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:40.448068+0000","last_change":"2024-08-17T02:27:38.232881+0000","last_active":"2024-08-17T02:27:40.448068+0000","last_peered":"2024-08-17T02:27:40.448068+0000","last_clean":"2024-08-17T02:27:40.448068+0000","last_became_active":"2024-08-17T02:27:38.232605+0000","last_became_peered":"2024-08-17T02:27:38.232605+0000","last_unstale":"2024-08-17T02:27:40.448068+0000","last_undegraded":"2024-08-17T02:27:40.448068+0000","last_fullsized":"2024-08-17T02:27:40.448068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965104+0000","last_change":"2024-08-17T02:27:38.964318+0000","last_active":"2024-08-17T02:27:38.965104+0000","last_peered":"2024-08-17T02:27:38.965104+0000","last_clean":"2024-08-17T02:27:38.965104+0000","last_became_active":"2024-08-17T02:27:38.964068+0000","last_became_peered":"2024-08-17T02:27:38.964068+0000","last_unstale":"2024-08-17T02:27:38.965104+0000","last_undegraded":"2024-08-17T02:27:38.965104+0000","last_fullsized":"2024-08-17T02:27:38.965104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220792+0000","last_change":"2024-08-17T02:27:38.233166+0000","last_active":"2024-08-17T02:27:39.220792+0000","last_peered":"2024-08-17T02:27:39.220792+0000","last_clean":"2024-08-17T02:27:39.220792+0000","last_became_active":"2024-08-17T02:27:38.232772+0000","last_became_peered":"2024-08-17T02:27:38.232772+0000","last_unstale":"2024-08-17T02:27:39.220792+0000","last_undegraded":"2024-08-17T02:27:39.220792+0000","last_fullsized":"2024-08-17T02:27:39.220792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950572+0000","last_change":"2024-08-17T02:27:38.947496+0000","last_active":"2024-08-17T02:27:38.950572+0000","last_peered":"2024-08-17T02:27:38.950572+0000","last_clean":"2024-08-17T02:27:38.950572+0000","last_became_active":"2024-08-17T02:27:38.945946+0000","last_became_peered":"2024-08-17T02:27:38.945946+0000","last_unstale":"2024-08-17T02:27:38.950572+0000","last_undegraded":"2024-08-17T02:27:38.950572+0000","last_fullsized":"2024-08-17T02:27:38.950572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937161+0000","last_change":"2024-08-17T02:27:38.225331+0000","last_active":"2024-08-17T02:27:38.937161+0000","last_peered":"2024-08-17T02:27:38.937161+0000","last_clean":"2024-08-17T02:27:38.937161+0000","last_became_active":"2024-08-17T02:27:38.222853+0000","last_became_peered":"2024-08-17T02:27:38.222853+0000","last_unstale":"2024-08-17T02:27:38.937161+0000","last_undegraded":"2024-08-17T02:27:38.937161+0000","last_fullsized":"2024-08-17T02:27:38.937161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962392+0000","last_change":"2024-08-17T02:27:38.957489+0000","last_active":"2024-08-17T02:27:38.962392+0000","last_peered":"2024-08-17T02:27:38.962392+0000","last_clean":"2024-08-17T02:27:38.962392+0000","last_became_active":"2024-08-17T02:27:38.957214+0000","last_became_peered":"2024-08-17T02:27:38.957214+0000","last_unstale":"2024-08-17T02:27:38.962392+0000","last_undegraded":"2024-08-17T02:27:38.962392+0000","last_fullsized":"2024-08-17T02:27:38.962392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:19.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932946+0000","last_change":"2024-08-17T02:27:38.234553+0000","last_active":"2024-08-17T02:27:38.932946+0000","last_peered":"2024-08-17T02:27:38.932946+0000","last_clean":"2024-08-17T02:27:38.932946+0000","last_became_active":"2024-08-17T02:27:38.234040+0000","last_became_peered":"2024-08-17T02:27:38.234040+0000","last_unstale":"2024-08-17T02:27:38.932946+0000","last_undegraded":"2024-08-17T02:27:38.932946+0000","last_fullsized":"2024-08-17T02:27:38.932946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950101+0000","last_change":"2024-08-17T02:27:38.946873+0000","last_active":"2024-08-17T02:27:38.950101+0000","last_peered":"2024-08-17T02:27:38.950101+0000","last_clean":"2024-08-17T02:27:38.950101+0000","last_became_active":"2024-08-17T02:27:38.946553+0000","last_became_peered":"2024-08-17T02:27:38.946553+0000","last_unstale":"2024-08-17T02:27:38.950101+0000","last_undegraded":"2024-08-17T02:27:38.950101+0000","last_fullsized":"2024-08-17T02:27:38.950101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933576+0000","last_change":"2024-08-17T02:27:38.235261+0000","last_active":"2024-08-17T02:27:38.933576+0000","last_peered":"2024-08-17T02:27:38.933576+0000","last_clean":"2024-08-17T02:27:38.933576+0000","last_became_active":"2024-08-17T02:27:38.234975+0000","last_became_peered":"2024-08-17T02:27:38.234975+0000","last_unstale":"2024-08-17T02:27:38.933576+0000","last_undegraded":"2024-08-17T02:27:38.933576+0000","last_fullsized":"2024-08-17T02:27:38.933576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951870+0000","last_change":"2024-08-17T02:27:38.948237+0000","last_active":"2024-08-17T02:27:38.951870+0000","last_peered":"2024-08-17T02:27:38.951870+0000","last_clean":"2024-08-17T02:27:38.951870+0000","last_became_active":"2024-08-17T02:27:38.947980+0000","last_became_peered":"2024-08-17T02:27:38.947980+0000","last_unstale":"2024-08-17T02:27:38.951870+0000","last_undegraded":"2024-08-17T02:27:38.951870+0000","last_fullsized":"2024-08-17T02:27:38.951870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220208+0000","last_change":"2024-08-17T02:27:38.224385+0000","last_active":"2024-08-17T02:27:39.220208+0000","last_peered":"2024-08-17T02:27:39.220208+0000","last_clean":"2024-08-17T02:27:39.220208+0000","last_became_active":"2024-08-17T02:27:38.224112+0000","last_became_peered":"2024-08-17T02:27:38.224112+0000","last_unstale":"2024-08-17T02:27:39.220208+0000","last_undegraded":"2024-08-17T02:27:39.220208+0000","last_fullsized":"2024-08-17T02:27:39.220208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960003+0000","last_change":"2024-08-17T02:27:38.958582+0000","last_active":"2024-08-17T02:27:38.960003+0000","last_peered":"2024-08-17T02:27:38.960003+0000","last_clean":"2024-08-17T02:27:38.960003+0000","last_became_active":"2024-08-17T02:27:38.958297+0000","last_became_peered":"2024-08-17T02:27:38.958297+0000","last_unstale":"2024-08-17T02:27:38.960003+0000","last_undegraded":"2024-08-17T02:27:38.960003+0000","last_fullsized":"2024-08-17T02:27:38.960003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965620+0000","last_change":"2024-08-17T02:27:38.958334+0000","last_active":"2024-08-17T02:27:38.965620+0000","last_peered":"2024-08-17T02:27:38.965620+0000","last_clean":"2024-08-17T02:27:38.965620+0000","last_became_active":"2024-08-17T02:27:38.958023+0000","last_became_peered":"2024-08-17T02:27:38.958023+0000","last_unstale":"2024-08-17T02:27:38.965620+0000","last_undegraded":"2024-08-17T02:27:38.965620+0000","last_fullsized":"2024-08-17T02:27:38.965620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221510+0000","last_change":"2024-08-17T02:27:38.227961+0000","last_active":"2024-08-17T02:27:39.221510+0000","last_peered":"2024-08-17T02:27:39.221510+0000","last_clean":"2024-08-17T02:27:39.221510+0000","last_became_active":"2024-08-17T02:27:38.227515+0000","last_became_peered":"2024-08-17T02:27:38.227515+0000","last_unstale":"2024-08-17T02:27:39.221510+0000","last_undegraded":"2024-08-17T02:27:39.221510+0000","last_fullsized":"2024-08-17T02:27:39.221510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962441+0000","last_change":"2024-08-17T02:27:38.956122+0000","last_active":"2024-08-17T02:27:38.962441+0000","last_peered":"2024-08-17T02:27:38.962441+0000","last_clean":"2024-08-17T02:27:38.962441+0000","last_became_active":"2024-08-17T02:27:38.955849+0000","last_became_peered":"2024-08-17T02:27:38.955849+0000","last_unstale":"2024-08-17T02:27:38.962441+0000","last_undegraded":"2024-08-17T02:27:38.962441+0000","last_fullsized":"2024-08-17T02:27:38.962441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220743+0000","last_change":"2024-08-17T02:27:38.229758+0000","last_active":"2024-08-17T02:27:39.220743+0000","last_peered":"2024-08-17T02:27:39.220743+0000","last_clean":"2024-08-17T02:27:39.220743+0000","last_became_active":"2024-08-17T02:27:38.229308+0000","last_became_peered":"2024-08-17T02:27:38.229308+0000","last_unstale":"2024-08-17T02:27:39.220743+0000","last_undegraded":"2024-08-17T02:27:39.220743+0000","last_fullsized":"2024-08-17T02:27:39.220743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953549+0000","last_change":"2024-08-17T02:27:38.951247+0000","last_active":"2024-08-17T02:27:38.953549+0000","last_peered":"2024-08-17T02:27:38.953549+0000","last_clean":"2024-08-17T02:27:38.953549+0000","last_became_active":"2024-08-17T02:27:38.950979+0000","last_became_peered":"2024-08-17T02:27:38.950979+0000","last_unstale":"2024-08-17T02:27:38.953549+0000","last_undegraded":"2024-08-17T02:27:38.953549+0000","last_fullsized":"2024-08-17T02:27:38.953549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:13.804400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220328+0000","last_change":"2024-08-17T02:27:38.231845+0000","last_active":"2024-08-17T02:27:39.220328+0000","last_peered":"2024-08-17T02:27:39.220328+0000","last_clean":"2024-08-17T02:27:39.220328+0000","last_became_active":"2024-08-17T02:27:38.231535+0000","last_became_peered":"2024-08-17T02:27:38.231535+0000","last_unstale":"2024-08-17T02:27:39.220328+0000","last_undegraded":"2024-08-17T02:27:39.220328+0000","last_fullsized":"2024-08-17T02:27:39.220328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953028+0000","last_change":"2024-08-17T02:27:38.950278+0000","last_active":"2024-08-17T02:27:38.953028+0000","last_peered":"2024-08-17T02:27:38.953028+0000","last_clean":"2024-08-17T02:27:38.953028+0000","last_became_active":"2024-08-17T02:27:38.949470+0000","last_became_peered":"2024-08-17T02:27:38.949470+0000","last_unstale":"2024-08-17T02:27:38.953028+0000","last_undegraded":"2024-08-17T02:27:38.953028+0000","last_fullsized":"2024-08-17T02:27:38.953028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222977+0000","last_change":"2024-08-17T02:27:38.227009+0000","last_active":"2024-08-17T02:27:39.222977+0000","last_peered":"2024-08-17T02:27:39.222977+0000","last_clean":"2024-08-17T02:27:39.222977+0000","last_became_active":"2024-08-17T02:27:38.226613+0000","last_became_peered":"2024-08-17T02:27:38.226613+0000","last_unstale":"2024-08-17T02:27:39.222977+0000","last_undegraded":"2024-08-17T02:27:39.222977+0000","last_fullsized":"2024-08-17T02:27:39.222977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:36.242448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:48.441 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:48.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.627+0000 7f3d97e00640 1 Processor -- start 2024-08-17T02:27:48.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.627+0000 7f3d97e00640 1 -- start start 2024-08-17T02:27:48.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.628+0000 7f3d97e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3d980c5c40 0x7f3d980caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.628+0000 7f3d97e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980cc890 con 0x7f3d980aed50 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.628+0000 7f3d97e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980cb4c0 con 0x7f3d980ce8a0 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d97e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980cb7a0 con 0x7f3d980c5c40 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d8e000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3d980ce8a0 0x7f3d980ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46094/0 (socket says 172.21.15.46:46094) 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d8e000640 1 -- 172.21.15.46:0/287430257 learned_addr learned my addr 172.21.15.46:0/287430257 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:48.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d97400640 1 --2- 172.21.15.46:0/287430257 >> v2:172.21.15.46:3300/0 conn(0x7f3d980c5c40 0x7f3d980caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097485464 0 0) 0x7f3d980cb4c0 con 0x7f3d980ce8a0 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d7c0034e0 con 0x7f3d980ce8a0 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d97400640 1 -- 172.21.15.46:0/287430257 >> v1:172.21.15.162:6789/0 conn(0x7f3d980ce8a0 legacy=0x7f3d980ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d97400640 1 -- 172.21.15.46:0/287430257 >> v1:172.21.15.46:6789/0 conn(0x7f3d980aed50 legacy=0x7f3d980ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640709389 0 0) 0x7f3d980cc890 con 0x7f3d980aed50 2024-08-17T02:27:48.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.629+0000 7f3d97400640 1 -- 172.21.15.46:0/287430257 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980cba80 con 0x7f3d980c5c40 2024-08-17T02:27:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.630+0000 7f3d97400640 1 --2- 172.21.15.46:0/287430257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d980caec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009e60 tx=0x7f3d90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e11ca4d2bac3e87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90007550 con 0x7f3d980c5c40 2024-08-17T02:27:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9002d050 con 0x7f3d980c5c40 2024-08-17T02:27:48.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d96000640 1 -- 172.21.15.46:0/287430257 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90007900 con 0x7f3d980c5c40 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 -- 172.21.15.46:0/287430257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 msgr2=0x7f3d980caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 --2- 172.21.15.46:0/287430257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d980caec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009e60 tx=0x7f3d90009780 comp rx=0 tx=0).stop 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 -- 172.21.15.46:0/287430257 shutdown_connections 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 --2- 172.21.15.46:0/287430257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d980caec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 -- 172.21.15.46:0/287430257 >> 172.21.15.46:0/287430257 conn(0x7f3d98098e30 msgr2=0x7f3d9806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 -- 172.21.15.46:0/287430257 shutdown_connections 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.631+0000 7f3d97e00640 1 -- 172.21.15.46:0/287430257 wait complete. 2024-08-17T02:27:48.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.633+0000 7f3d97e00640 1 Processor -- start 2024-08-17T02:27:48.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.633+0000 7f3d97e00640 1 -- start start 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d980aed50 0x7f3d980b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d980ce8a0 0x7f3d980cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980b58d0 con 0x7f3d980c5c40 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9816ca40 con 0x7f3d980aed50 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980c84b0 con 0x7f3d980ce8a0 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40930/0 (socket says 172.21.15.46:40930) 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d8e000640 1 -- 172.21.15.46:0/2524699201 learned_addr learned my addr 172.21.15.46:0/2524699201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d97400640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d980ce8a0 0x7f3d980cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d96a00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d980aed50 0x7f3d980b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.634+0000 7f3d8e000640 1 -- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d980ce8a0 msgr2=0x7f3d980cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8e000640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d980ce8a0 0x7f3d980cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8e000640 1 -- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d980aed50 msgr2=0x7f3d980b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8e000640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d980aed50 0x7f3d980b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8e000640 1 -- 172.21.15.46:0/2524699201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90009a20 con 0x7f3d980c5c40 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8e000640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c5b0 tx=0x7f3d80007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80005b70 con 0x7f3d980c5c40 2024-08-17T02:27:48.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80005cf0 con 0x7f3d980c5c40 2024-08-17T02:27:48.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80007340 con 0x7f3d980c5c40 2024-08-17T02:27:48.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d980b5310 con 0x7f3d980c5c40 2024-08-17T02:27:48.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.635+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d980c8750 con 0x7f3d980c5c40 2024-08-17T02:27:48.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.636+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d98071050 con 0x7f3d980c5c40 2024-08-17T02:27:48.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.637+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3d8001b400 con 0x7f3d980c5c40 2024-08-17T02:27:48.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.638+0000 7f3d8ea00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 0x7f3d74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.638+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d80081ee0 con 0x7f3d980c5c40 2024-08-17T02:27:48.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.639+0000 7f3d96a00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 0x7f3d74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.639+0000 7f3d96a00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 0x7f3d74067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d88007fd0 tx=0x7f3d88007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.642+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3d80050030 con 0x7f3d980c5c40 2024-08-17T02:27:48.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.824+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d980ce380 con 0x7f3d74065150 2024-08-17T02:27:48.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.831+0000 7f3d8ea00640 1 -- 172.21.15.46:0/2524699201 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264570 (secure 0 0 0) 0x7f3d980ce380 con 0x7f3d74065150 2024-08-17T02:27:48.834 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:48.835 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:27:48.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 msgr2=0x7f3d74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 0x7f3d74067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d88007fd0 tx=0x7f3d88007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:48.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 msgr2=0x7f3d9816c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c5b0 tx=0x7f3d80007d70 comp rx=0 tx=0).stop 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 shutdown_connections 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3d74065150 0x7f3d74067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d980ce8a0 0x7f3d980cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d980c5c40 0x7f3d9816c500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 --2- 172.21.15.46:0/2524699201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d980aed50 0x7f3d980b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.835+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 >> 172.21.15.46:0/2524699201 conn(0x7f3d98098e30 msgr2=0x7f3d98068510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.836+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 shutdown_connections 2024-08-17T02:27:48.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:48.836+0000 7f3d97e00640 1 -- 172.21.15.46:0/2524699201 wait complete. 2024-08-17T02:27:48.850 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:27:47.013551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398768,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575952,"statfs":{"total":773094113280,"available":770637774848,"internally_reserved":0,"allocated":2990080,"data_stored":1787916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.081706"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962517+0000","last_change":"2024-08-17T02:27:38.958278+0000","last_active":"2024-08-17T02:27:38.962517+0000","last_peered":"2024-08-17T02:27:38.962517+0000","last_clean":"2024-08-17T02:27:38.962517+0000","last_became_active":"2024-08-17T02:27:38.957984+0000","last_became_peered":"2024-08-17T02:27:38.957984+0000","last_unstale":"2024-08-17T02:27:38.962517+0000","last_undegraded":"2024-08-17T02:27:38.962517+0000","last_fullsized":"2024-08-17T02:27:38.962517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.946817+0000","last_change":"2024-08-17T02:27:38.944267+0000","last_active":"2024-08-17T02:27:38.946817+0000","last_peered":"2024-08-17T02:27:38.946817+0000","last_clean":"2024-08-17T02:27:38.946817+0000","last_became_active":"2024-08-17T02:27:38.944006+0000","last_became_peered":"2024-08-17T02:27:38.944006+0000","last_unstale":"2024-08-17T02:27:38.946817+0000","last_undegraded":"2024-08-17T02:27:38.946817+0000","last_fullsized":"2024-08-17T02:27:38.946817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944649+0000","last_change":"2024-08-17T02:27:38.942978+0000","last_active":"2024-08-17T02:27:38.944649+0000","last_peered":"2024-08-17T02:27:38.944649+0000","last_clean":"2024-08-17T02:27:38.944649+0000","last_became_active":"2024-08-17T02:27:38.942718+0000","last_became_peered":"2024-08-17T02:27:38.942718+0000","last_unstale":"2024-08-17T02:27:38.944649+0000","last_undegraded":"2024-08-17T02:27:38.944649+0000","last_fullsized":"2024-08-17T02:27:38.944649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962421+0000","last_change":"2024-08-17T02:27:38.952449+0000","last_active":"2024-08-17T02:27:38.962421+0000","last_peered":"2024-08-17T02:27:38.962421+0000","last_clean":"2024-08-17T02:27:38.962421+0000","last_became_active":"2024-08-17T02:27:38.951835+0000","last_became_peered":"2024-08-17T02:27:38.951835+0000","last_unstale":"2024-08-17T02:27:38.962421+0000","last_undegraded":"2024-08-17T02:27:38.962421+0000","last_fullsized":"2024-08-17T02:27:38.962421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:04.509487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959709+0000","last_change":"2024-08-17T02:27:38.955373+0000","last_active":"2024-08-17T02:27:38.959709+0000","last_peered":"2024-08-17T02:27:38.959709+0000","last_clean":"2024-08-17T02:27:38.959709+0000","last_became_active":"2024-08-17T02:27:38.955029+0000","last_became_peered":"2024-08-17T02:27:38.955029+0000","last_unstale":"2024-08-17T02:27:38.959709+0000","last_undegraded":"2024-08-17T02:27:38.959709+0000","last_fullsized":"2024-08-17T02:27:38.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.947951+0000","last_change":"2024-08-17T02:27:38.942516+0000","last_active":"2024-08-17T02:27:38.947951+0000","last_peered":"2024-08-17T02:27:38.947951+0000","last_clean":"2024-08-17T02:27:38.947951+0000","last_became_active":"2024-08-17T02:27:38.942194+0000","last_became_peered":"2024-08-17T02:27:38.942194+0000","last_unstale":"2024-08-17T02:27:38.947951+0000","last_undegraded":"2024-08-17T02:27:38.947951+0000","last_fullsized":"2024-08-17T02:27:38.947951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960316+0000","last_change":"2024-08-17T02:27:38.946154+0000","last_active":"2024-08-17T02:27:38.960316+0000","last_peered":"2024-08-17T02:27:38.960316+0000","last_clean":"2024-08-17T02:27:38.960316+0000","last_became_active":"2024-08-17T02:27:38.945737+0000","last_became_peered":"2024-08-17T02:27:38.945737+0000","last_unstale":"2024-08-17T02:27:38.960316+0000","last_undegraded":"2024-08-17T02:27:38.960316+0000","last_fullsized":"2024-08-17T02:27:38.960316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.956360+0000","last_change":"2024-08-17T02:27:38.955006+0000","last_active":"2024-08-17T02:27:38.956360+0000","last_peered":"2024-08-17T02:27:38.956360+0000","last_clean":"2024-08-17T02:27:38.956360+0000","last_became_active":"2024-08-17T02:27:38.954720+0000","last_became_peered":"2024-08-17T02:27:38.954720+0000","last_unstale":"2024-08-17T02:27:38.956360+0000","last_undegraded":"2024-08-17T02:27:38.956360+0000","last_fullsized":"2024-08-17T02:27:38.956360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966232+0000","last_change":"2024-08-17T02:27:38.964613+0000","last_active":"2024-08-17T02:27:38.966232+0000","last_peered":"2024-08-17T02:27:38.966232+0000","last_clean":"2024-08-17T02:27:38.966232+0000","last_became_active":"2024-08-17T02:27:38.964331+0000","last_became_peered":"2024-08-17T02:27:38.964331+0000","last_unstale":"2024-08-17T02:27:38.966232+0000","last_undegraded":"2024-08-17T02:27:38.966232+0000","last_fullsized":"2024-08-17T02:27:38.966232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:36:44.158845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954749+0000","last_change":"2024-08-17T02:27:38.952858+0000","last_active":"2024-08-17T02:27:38.954749+0000","last_peered":"2024-08-17T02:27:38.954749+0000","last_clean":"2024-08-17T02:27:38.954749+0000","last_became_active":"2024-08-17T02:27:38.951695+0000","last_became_peered":"2024-08-17T02:27:38.951695+0000","last_unstale":"2024-08-17T02:27:38.954749+0000","last_undegraded":"2024-08-17T02:27:38.954749+0000","last_fullsized":"2024-08-17T02:27:38.954749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952093+0000","last_change":"2024-08-17T02:27:38.949326+0000","last_active":"2024-08-17T02:27:38.952093+0000","last_peered":"2024-08-17T02:27:38.952093+0000","last_clean":"2024-08-17T02:27:38.952093+0000","last_became_active":"2024-08-17T02:27:38.948495+0000","last_became_peered":"2024-08-17T02:27:38.948495+0000","last_unstale":"2024-08-17T02:27:38.952093+0000","last_undegraded":"2024-08-17T02:27:38.952093+0000","last_fullsized":"2024-08-17T02:27:38.952093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962468+0000","last_change":"2024-08-17T02:27:38.957539+0000","last_active":"2024-08-17T02:27:38.962468+0000","last_peered":"2024-08-17T02:27:38.962468+0000","last_clean":"2024-08-17T02:27:38.962468+0000","last_became_active":"2024-08-17T02:27:38.957141+0000","last_became_peered":"2024-08-17T02:27:38.957141+0000","last_unstale":"2024-08-17T02:27:38.962468+0000","last_undegraded":"2024-08-17T02:27:38.962468+0000","last_fullsized":"2024-08-17T02:27:38.962468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953273+0000","last_change":"2024-08-17T02:27:38.951276+0000","last_active":"2024-08-17T02:27:38.953273+0000","last_peered":"2024-08-17T02:27:38.953273+0000","last_clean":"2024-08-17T02:27:38.953273+0000","last_became_active":"2024-08-17T02:27:38.951019+0000","last_became_peered":"2024-08-17T02:27:38.951019+0000","last_unstale":"2024-08-17T02:27:38.953273+0000","last_undegraded":"2024-08-17T02:27:38.953273+0000","last_fullsized":"2024-08-17T02:27:38.953273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945764+0000","last_change":"2024-08-17T02:27:38.944212+0000","last_active":"2024-08-17T02:27:38.945764+0000","last_peered":"2024-08-17T02:27:38.945764+0000","last_clean":"2024-08-17T02:27:38.945764+0000","last_became_active":"2024-08-17T02:27:38.943893+0000","last_became_peered":"2024-08-17T02:27:38.943893+0000","last_unstale":"2024-08-17T02:27:38.945764+0000","last_undegraded":"2024-08-17T02:27:38.945764+0000","last_fullsized":"2024-08-17T02:27:38.945764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964237+0000","last_change":"2024-08-17T02:27:38.963326+0000","last_active":"2024-08-17T02:27:38.964237+0000","last_peered":"2024-08-17T02:27:38.964237+0000","last_clean":"2024-08-17T02:27:38.964237+0000","last_became_active":"2024-08-17T02:27:38.963045+0000","last_became_peered":"2024-08-17T02:27:38.963045+0000","last_unstale":"2024-08-17T02:27:38.964237+0000","last_undegraded":"2024-08-17T02:27:38.964237+0000","last_fullsized":"2024-08-17T02:27:38.964237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945157+0000","last_change":"2024-08-17T02:27:38.942730+0000","last_active":"2024-08-17T02:27:38.945157+0000","last_peered":"2024-08-17T02:27:38.945157+0000","last_clean":"2024-08-17T02:27:38.945157+0000","last_became_active":"2024-08-17T02:27:38.942318+0000","last_became_peered":"2024-08-17T02:27:38.942318+0000","last_unstale":"2024-08-17T02:27:38.945157+0000","last_undegraded":"2024-08-17T02:27:38.945157+0000","last_fullsized":"2024-08-17T02:27:38.945157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965284+0000","last_change":"2024-08-17T02:27:38.957401+0000","last_active":"2024-08-17T02:27:38.965284+0000","last_peered":"2024-08-17T02:27:38.965284+0000","last_clean":"2024-08-17T02:27:38.965284+0000","last_became_active":"2024-08-17T02:27:38.956806+0000","last_became_peered":"2024-08-17T02:27:38.956806+0000","last_unstale":"2024-08-17T02:27:38.965284+0000","last_undegraded":"2024-08-17T02:27:38.965284+0000","last_fullsized":"2024-08-17T02:27:38.965284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951390+0000","last_change":"2024-08-17T02:27:38.948303+0000","last_active":"2024-08-17T02:27:38.951390+0000","last_peered":"2024-08-17T02:27:38.951390+0000","last_clean":"2024-08-17T02:27:38.951390+0000","last_became_active":"2024-08-17T02:27:38.948045+0000","last_became_peered":"2024-08-17T02:27:38.948045+0000","last_unstale":"2024-08-17T02:27:38.951390+0000","last_undegraded":"2024-08-17T02:27:38.951390+0000","last_fullsized":"2024-08-17T02:27:38.951390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:58.173279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957615+0000","last_change":"2024-08-17T02:27:38.955302+0000","last_active":"2024-08-17T02:27:38.957615+0000","last_peered":"2024-08-17T02:27:38.957615+0000","last_clean":"2024-08-17T02:27:38.957615+0000","last_became_active":"2024-08-17T02:27:38.955011+0000","last_became_peered":"2024-08-17T02:27:38.955011+0000","last_unstale":"2024-08-17T02:27:38.957615+0000","last_undegraded":"2024-08-17T02:27:38.957615+0000","last_fullsized":"2024-08-17T02:27:38.957615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965503+0000","last_change":"2024-08-17T02:27:38.962208+0000","last_active":"2024-08-17T02:27:38.965503+0000","last_peered":"2024-08-17T02:27:38.965503+0000","last_clean":"2024-08-17T02:27:38.965503+0000","last_became_active":"2024-08-17T02:27:38.961860+0000","last_became_peered":"2024-08-17T02:27:38.961860+0000","last_unstale":"2024-08-17T02:27:38.965503+0000","last_undegraded":"2024-08-17T02:27:38.965503+0000","last_fullsized":"2024-08-17T02:27:38.965503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961179+0000","last_change":"2024-08-17T02:27:38.960549+0000","last_active":"2024-08-17T02:27:38.961179+0000","last_peered":"2024-08-17T02:27:38.961179+0000","last_clean":"2024-08-17T02:27:38.961179+0000","last_became_active":"2024-08-17T02:27:38.960365+0000","last_became_peered":"2024-08-17T02:27:38.960365+0000","last_unstale":"2024-08-17T02:27:38.961179+0000","last_undegraded":"2024-08-17T02:27:38.961179+0000","last_fullsized":"2024-08-17T02:27:38.961179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962883+0000","last_change":"2024-08-17T02:27:38.956102+0000","last_active":"2024-08-17T02:27:38.962883+0000","last_peered":"2024-08-17T02:27:38.962883+0000","last_clean":"2024-08-17T02:27:38.962883+0000","last_became_active":"2024-08-17T02:27:38.955662+0000","last_became_peered":"2024-08-17T02:27:38.955662+0000","last_unstale":"2024-08-17T02:27:38.962883+0000","last_undegraded":"2024-08-17T02:27:38.962883+0000","last_fullsized":"2024-08-17T02:27:38.962883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:52:29.585670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963896+0000","last_change":"2024-08-17T02:27:38.963135+0000","last_active":"2024-08-17T02:27:38.963896+0000","last_peered":"2024-08-17T02:27:38.963896+0000","last_clean":"2024-08-17T02:27:38.963896+0000","last_became_active":"2024-08-17T02:27:38.962870+0000","last_became_peered":"2024-08-17T02:27:38.962870+0000","last_unstale":"2024-08-17T02:27:38.963896+0000","last_undegraded":"2024-08-17T02:27:38.963896+0000","last_fullsized":"2024-08-17T02:27:38.963896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962232+0000","last_change":"2024-08-17T02:27:38.954011+0000","last_active":"2024-08-17T02:27:38.962232+0000","last_peered":"2024-08-17T02:27:38.962232+0000","last_clean":"2024-08-17T02:27:38.962232+0000","last_became_active":"2024-08-17T02:27:38.950742+0000","last_became_peered":"2024-08-17T02:27:38.950742+0000","last_unstale":"2024-08-17T02:27:38.962232+0000","last_undegraded":"2024-08-17T02:27:38.962232+0000","last_fullsized":"2024-08-17T02:27:38.962232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957913+0000","last_change":"2024-08-17T02:27:38.956849+0000","last_active":"2024-08-17T02:27:38.957913+0000","last_peered":"2024-08-17T02:27:38.957913+0000","last_clean":"2024-08-17T02:27:38.957913+0000","last_became_active":"2024-08-17T02:27:38.956343+0000","last_became_peered":"2024-08-17T02:27:38.956343+0000","last_unstale":"2024-08-17T02:27:38.957913+0000","last_undegraded":"2024-08-17T02:27:38.957913+0000","last_fullsized":"2024-08-17T02:27:38.957913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966173+0000","last_change":"2024-08-17T02:27:38.964205+0000","last_active":"2024-08-17T02:27:38.966173+0000","last_peered":"2024-08-17T02:27:38.966173+0000","last_clean":"2024-08-17T02:27:38.966173+0000","last_became_active":"2024-08-17T02:27:38.963917+0000","last_became_peered":"2024-08-17T02:27:38.963917+0000","last_unstale":"2024-08-17T02:27:38.966173+0000","last_undegraded":"2024-08-17T02:27:38.966173+0000","last_fullsized":"2024-08-17T02:27:38.966173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953689+0000","last_change":"2024-08-17T02:27:38.952501+0000","last_active":"2024-08-17T02:27:38.953689+0000","last_peered":"2024-08-17T02:27:38.953689+0000","last_clean":"2024-08-17T02:27:38.953689+0000","last_became_active":"2024-08-17T02:27:38.952172+0000","last_became_peered":"2024-08-17T02:27:38.952172+0000","last_unstale":"2024-08-17T02:27:38.953689+0000","last_undegraded":"2024-08-17T02:27:38.953689+0000","last_fullsized":"2024-08-17T02:27:38.953689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.957901+0000","last_change":"2024-08-17T02:27:38.956673+0000","last_active":"2024-08-17T02:27:38.957901+0000","last_peered":"2024-08-17T02:27:38.957901+0000","last_clean":"2024-08-17T02:27:38.957901+0000","last_became_active":"2024-08-17T02:27:38.956396+0000","last_became_peered":"2024-08-17T02:27:38.956396+0000","last_unstale":"2024-08-17T02:27:38.957901+0000","last_undegraded":"2024-08-17T02:27:38.957901+0000","last_fullsized":"2024-08-17T02:27:38.957901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953576+0000","last_change":"2024-08-17T02:27:38.952052+0000","last_active":"2024-08-17T02:27:38.953576+0000","last_peered":"2024-08-17T02:27:38.953576+0000","last_clean":"2024-08-17T02:27:38.953576+0000","last_became_active":"2024-08-17T02:27:38.951782+0000","last_became_peered":"2024-08-17T02:27:38.951782+0000","last_unstale":"2024-08-17T02:27:38.953576+0000","last_undegraded":"2024-08-17T02:27:38.953576+0000","last_fullsized":"2024-08-17T02:27:38.953576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962863+0000","last_change":"2024-08-17T02:27:38.951396+0000","last_active":"2024-08-17T02:27:38.962863+0000","last_peered":"2024-08-17T02:27:38.962863+0000","last_clean":"2024-08-17T02:27:38.962863+0000","last_became_active":"2024-08-17T02:27:38.950821+0000","last_became_peered":"2024-08-17T02:27:38.950821+0000","last_unstale":"2024-08-17T02:27:38.962863+0000","last_undegraded":"2024-08-17T02:27:38.962863+0000","last_fullsized":"2024-08-17T02:27:38.962863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.944409+0000","last_change":"2024-08-17T02:27:38.942963+0000","last_active":"2024-08-17T02:27:38.944409+0000","last_peered":"2024-08-17T02:27:38.944409+0000","last_clean":"2024-08-17T02:27:38.944409+0000","last_became_active":"2024-08-17T02:27:38.942517+0000","last_became_peered":"2024-08-17T02:27:38.942517+0000","last_unstale":"2024-08-17T02:27:38.944409+0000","last_undegraded":"2024-08-17T02:27:38.944409+0000","last_fullsized":"2024-08-17T02:27:38.944409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.948174+0000","last_change":"2024-08-17T02:27:38.945072+0000","last_active":"2024-08-17T02:27:38.948174+0000","last_peered":"2024-08-17T02:27:38.948174+0000","last_clean":"2024-08-17T02:27:38.948174+0000","last_became_active":"2024-08-17T02:27:38.944747+0000","last_became_peered":"2024-08-17T02:27:38.944747+0000","last_unstale":"2024-08-17T02:27:38.948174+0000","last_undegraded":"2024-08-17T02:27:38.948174+0000","last_fullsized":"2024-08-17T02:27:38.948174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960742+0000","last_change":"2024-08-17T02:27:38.954890+0000","last_active":"2024-08-17T02:27:38.960742+0000","last_peered":"2024-08-17T02:27:38.960742+0000","last_clean":"2024-08-17T02:27:38.960742+0000","last_became_active":"2024-08-17T02:27:38.954069+0000","last_became_peered":"2024-08-17T02:27:38.954069+0000","last_unstale":"2024-08-17T02:27:38.960742+0000","last_undegraded":"2024-08-17T02:27:38.960742+0000","last_fullsized":"2024-08-17T02:27:38.960742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:42.491217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220847+0000","last_change":"2024-08-17T02:27:38.231207+0000","last_active":"2024-08-17T02:27:39.220847+0000","last_peered":"2024-08-17T02:27:39.220847+0000","last_clean":"2024-08-17T02:27:39.220847+0000","last_became_active":"2024-08-17T02:27:38.230920+0000","last_became_peered":"2024-08-17T02:27:38.230920+0000","last_unstale":"2024-08-17T02:27:39.220847+0000","last_undegraded":"2024-08-17T02:27:39.220847+0000","last_fullsized":"2024-08-17T02:27:39.220847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.959071+0000","last_change":"2024-08-17T02:27:38.958530+0000","last_active":"2024-08-17T02:27:38.959071+0000","last_peered":"2024-08-17T02:27:38.959071+0000","last_clean":"2024-08-17T02:27:38.959071+0000","last_became_active":"2024-08-17T02:27:38.958248+0000","last_became_peered":"2024-08-17T02:27:38.958248+0000","last_unstale":"2024-08-17T02:27:38.959071+0000","last_undegraded":"2024-08-17T02:27:38.959071+0000","last_fullsized":"2024-08-17T02:27:38.959071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:03.268893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220075+0000","last_change":"2024-08-17T02:27:38.230888+0000","last_active":"2024-08-17T02:27:39.220075+0000","last_peered":"2024-08-17T02:27:39.220075+0000","last_clean":"2024-08-17T02:27:39.220075+0000","last_became_active":"2024-08-17T02:27:38.230628+0000","last_became_peered":"2024-08-17T02:27:38.230628+0000","last_unstale":"2024-08-17T02:27:39.220075+0000","last_undegraded":"2024-08-17T02:27:39.220075+0000","last_fullsized":"2024-08-17T02:27:39.220075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.945305+0000","last_change":"2024-08-17T02:27:38.232578+0000","last_active":"2024-08-17T02:27:38.945305+0000","last_peered":"2024-08-17T02:27:38.945305+0000","last_clean":"2024-08-17T02:27:38.945305+0000","last_became_active":"2024-08-17T02:27:38.232328+0000","last_became_peered":"2024-08-17T02:27:38.232328+0000","last_unstale":"2024-08-17T02:27:38.945305+0000","last_undegraded":"2024-08-17T02:27:38.945305+0000","last_fullsized":"2024-08-17T02:27:38.945305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952818+0000","last_change":"2024-08-17T02:27:38.949107+0000","last_active":"2024-08-17T02:27:38.952818+0000","last_peered":"2024-08-17T02:27:38.952818+0000","last_clean":"2024-08-17T02:27:38.952818+0000","last_became_active":"2024-08-17T02:27:38.948752+0000","last_became_peered":"2024-08-17T02:27:38.948752+0000","last_unstale":"2024-08-17T02:27:38.952818+0000","last_undegraded":"2024-08-17T02:27:38.952818+0000","last_fullsized":"2024-08-17T02:27:38.952818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935357+0000","last_change":"2024-08-17T02:27:38.231349+0000","last_active":"2024-08-17T02:27:38.935357+0000","last_peered":"2024-08-17T02:27:38.935357+0000","last_clean":"2024-08-17T02:27:38.935357+0000","last_became_active":"2024-08-17T02:27:38.229006+0000","last_became_peered":"2024-08-17T02:27:38.229006+0000","last_unstale":"2024-08-17T02:27:38.935357+0000","last_undegraded":"2024-08-17T02:27:38.935357+0000","last_fullsized":"2024-08-17T02:27:38.935357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950543+0000","last_change":"2024-08-17T02:27:38.947300+0000","last_active":"2024-08-17T02:27:38.950543+0000","last_peered":"2024-08-17T02:27:38.950543+0000","last_clean":"2024-08-17T02:27:38.950543+0000","last_became_active":"2024-08-17T02:27:38.947059+0000","last_became_peered":"2024-08-17T02:27:38.947059+0000","last_unstale":"2024-08-17T02:27:38.950543+0000","last_undegraded":"2024-08-17T02:27:38.950543+0000","last_fullsized":"2024-08-17T02:27:38.950543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940920+0000","last_change":"2024-08-17T02:27:38.232144+0000","last_active":"2024-08-17T02:27:38.940920+0000","last_peered":"2024-08-17T02:27:38.940920+0000","last_clean":"2024-08-17T02:27:38.940920+0000","last_became_active":"2024-08-17T02:27:38.231898+0000","last_became_peered":"2024-08-17T02:27:38.231898+0000","last_unstale":"2024-08-17T02:27:38.940920+0000","last_undegraded":"2024-08-17T02:27:38.940920+0000","last_fullsized":"2024-08-17T02:27:38.940920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963050+0000","last_change":"2024-08-17T02:27:38.956085+0000","last_active":"2024-08-17T02:27:38.963050+0000","last_peered":"2024-08-17T02:27:38.963050+0000","last_clean":"2024-08-17T02:27:38.963050+0000","last_became_active":"2024-08-17T02:27:38.955751+0000","last_became_peered":"2024-08-17T02:27:38.955751+0000","last_unstale":"2024-08-17T02:27:38.963050+0000","last_undegraded":"2024-08-17T02:27:38.963050+0000","last_fullsized":"2024-08-17T02:27:38.963050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936075+0000","last_change":"2024-08-17T02:27:38.232861+0000","last_active":"2024-08-17T02:27:38.936075+0000","last_peered":"2024-08-17T02:27:38.936075+0000","last_clean":"2024-08-17T02:27:38.936075+0000","last_became_active":"2024-08-17T02:27:38.232502+0000","last_became_peered":"2024-08-17T02:27:38.232502+0000","last_unstale":"2024-08-17T02:27:38.936075+0000","last_undegraded":"2024-08-17T02:27:38.936075+0000","last_fullsized":"2024-08-17T02:27:38.936075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953569+0000","last_change":"2024-08-17T02:27:38.951604+0000","last_active":"2024-08-17T02:27:38.953569+0000","last_peered":"2024-08-17T02:27:38.953569+0000","last_clean":"2024-08-17T02:27:38.953569+0000","last_became_active":"2024-08-17T02:27:38.950994+0000","last_became_peered":"2024-08-17T02:27:38.950994+0000","last_unstale":"2024-08-17T02:27:38.953569+0000","last_undegraded":"2024-08-17T02:27:38.953569+0000","last_fullsized":"2024-08-17T02:27:38.953569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:00.027288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222887+0000","last_change":"2024-08-17T02:27:38.236164+0000","last_active":"2024-08-17T02:27:39.222887+0000","last_peered":"2024-08-17T02:27:39.222887+0000","last_clean":"2024-08-17T02:27:39.222887+0000","last_became_active":"2024-08-17T02:27:38.235615+0000","last_became_peered":"2024-08-17T02:27:38.235615+0000","last_unstale":"2024-08-17T02:27:39.222887+0000","last_undegraded":"2024-08-17T02:27:39.222887+0000","last_fullsized":"2024-08-17T02:27:39.222887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965382+0000","last_change":"2024-08-17T02:27:38.962949+0000","last_active":"2024-08-17T02:27:38.965382+0000","last_peered":"2024-08-17T02:27:38.965382+0000","last_clean":"2024-08-17T02:27:38.965382+0000","last_became_active":"2024-08-17T02:27:38.960473+0000","last_became_peered":"2024-08-17T02:27:38.960473+0000","last_unstale":"2024-08-17T02:27:38.965382+0000","last_undegraded":"2024-08-17T02:27:38.965382+0000","last_fullsized":"2024-08-17T02:27:38.965382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:02.910612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.223251+0000","last_change":"2024-08-17T02:27:38.239544+0000","last_active":"2024-08-17T02:27:39.223251+0000","last_peered":"2024-08-17T02:27:39.223251+0000","last_clean":"2024-08-17T02:27:39.223251+0000","last_became_active":"2024-08-17T02:27:38.239105+0000","last_became_peered":"2024-08-17T02:27:38.239105+0000","last_unstale":"2024-08-17T02:27:39.223251+0000","last_undegraded":"2024-08-17T02:27:39.223251+0000","last_fullsized":"2024-08-17T02:27:39.223251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963452+0000","last_change":"2024-08-17T02:27:38.959403+0000","last_active":"2024-08-17T02:27:38.963452+0000","last_peered":"2024-08-17T02:27:38.963452+0000","last_clean":"2024-08-17T02:27:38.963452+0000","last_became_active":"2024-08-17T02:27:38.959187+0000","last_became_peered":"2024-08-17T02:27:38.959187+0000","last_unstale":"2024-08-17T02:27:38.963452+0000","last_undegraded":"2024-08-17T02:27:38.963452+0000","last_fullsized":"2024-08-17T02:27:38.963452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:14.152108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220958+0000","last_change":"2024-08-17T02:27:38.231982+0000","last_active":"2024-08-17T02:27:39.220958+0000","last_peered":"2024-08-17T02:27:39.220958+0000","last_clean":"2024-08-17T02:27:39.220958+0000","last_became_active":"2024-08-17T02:27:38.231721+0000","last_became_peered":"2024-08-17T02:27:38.231721+0000","last_unstale":"2024-08-17T02:27:39.220958+0000","last_undegraded":"2024-08-17T02:27:39.220958+0000","last_fullsized":"2024-08-17T02:27:39.220958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953724+0000","last_change":"2024-08-17T02:27:38.951652+0000","last_active":"2024-08-17T02:27:38.953724+0000","last_peered":"2024-08-17T02:27:38.953724+0000","last_clean":"2024-08-17T02:27:38.953724+0000","last_became_active":"2024-08-17T02:27:38.951389+0000","last_became_peered":"2024-08-17T02:27:38.951389+0000","last_unstale":"2024-08-17T02:27:38.953724+0000","last_undegraded":"2024-08-17T02:27:38.953724+0000","last_fullsized":"2024-08-17T02:27:38.953724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.936958+0000","last_change":"2024-08-17T02:27:38.232932+0000","last_active":"2024-08-17T02:27:38.936958+0000","last_peered":"2024-08-17T02:27:38.936958+0000","last_clean":"2024-08-17T02:27:38.936958+0000","last_became_active":"2024-08-17T02:27:38.232660+0000","last_became_peered":"2024-08-17T02:27:38.232660+0000","last_unstale":"2024-08-17T02:27:38.936958+0000","last_undegraded":"2024-08-17T02:27:38.936958+0000","last_fullsized":"2024-08-17T02:27:38.936958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.963894+0000","last_change":"2024-08-17T02:27:38.959826+0000","last_active":"2024-08-17T02:27:38.963894+0000","last_peered":"2024-08-17T02:27:38.963894+0000","last_clean":"2024-08-17T02:27:38.963894+0000","last_became_active":"2024-08-17T02:27:38.959504+0000","last_became_peered":"2024-08-17T02:27:38.959504+0000","last_unstale":"2024-08-17T02:27:38.963894+0000","last_undegraded":"2024-08-17T02:27:38.963894+0000","last_fullsized":"2024-08-17T02:27:38.963894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:29.827777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.940921+0000","last_change":"2024-08-17T02:27:38.228984+0000","last_active":"2024-08-17T02:27:38.940921+0000","last_peered":"2024-08-17T02:27:38.940921+0000","last_clean":"2024-08-17T02:27:38.940921+0000","last_became_active":"2024-08-17T02:27:38.228654+0000","last_became_peered":"2024-08-17T02:27:38.228654+0000","last_unstale":"2024-08-17T02:27:38.940921+0000","last_undegraded":"2024-08-17T02:27:38.940921+0000","last_fullsized":"2024-08-17T02:27:38.940921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952020+0000","last_change":"2024-08-17T02:27:38.949332+0000","last_active":"2024-08-17T02:27:38.952020+0000","last_peered":"2024-08-17T02:27:38.952020+0000","last_clean":"2024-08-17T02:27:38.952020+0000","last_became_active":"2024-08-17T02:27:38.948725+0000","last_became_peered":"2024-08-17T02:27:38.948725+0000","last_unstale":"2024-08-17T02:27:38.952020+0000","last_undegraded":"2024-08-17T02:27:38.952020+0000","last_fullsized":"2024-08-17T02:27:38.952020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221358+0000","last_change":"2024-08-17T02:27:38.234103+0000","last_active":"2024-08-17T02:27:39.221358+0000","last_peered":"2024-08-17T02:27:39.221358+0000","last_clean":"2024-08-17T02:27:39.221358+0000","last_became_active":"2024-08-17T02:27:38.233720+0000","last_became_peered":"2024-08-17T02:27:38.233720+0000","last_unstale":"2024-08-17T02:27:39.221358+0000","last_undegraded":"2024-08-17T02:27:39.221358+0000","last_fullsized":"2024-08-17T02:27:39.221358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.964797+0000","last_change":"2024-08-17T02:27:38.960907+0000","last_active":"2024-08-17T02:27:38.964797+0000","last_peered":"2024-08-17T02:27:38.964797+0000","last_clean":"2024-08-17T02:27:38.964797+0000","last_became_active":"2024-08-17T02:27:38.960512+0000","last_became_peered":"2024-08-17T02:27:38.960512+0000","last_unstale":"2024-08-17T02:27:38.964797+0000","last_undegraded":"2024-08-17T02:27:38.964797+0000","last_fullsized":"2024-08-17T02:27:38.964797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:12.070850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220665+0000","last_change":"2024-08-17T02:27:38.230338+0000","last_active":"2024-08-17T02:27:39.220665+0000","last_peered":"2024-08-17T02:27:39.220665+0000","last_clean":"2024-08-17T02:27:39.220665+0000","last_became_active":"2024-08-17T02:27:38.229932+0000","last_became_peered":"2024-08-17T02:27:38.229932+0000","last_unstale":"2024-08-17T02:27:39.220665+0000","last_undegraded":"2024-08-17T02:27:39.220665+0000","last_fullsized":"2024-08-17T02:27:39.220665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:58.401470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966062+0000","last_change":"2024-08-17T02:27:38.964572+0000","last_active":"2024-08-17T02:27:38.966062+0000","last_peered":"2024-08-17T02:27:38.966062+0000","last_clean":"2024-08-17T02:27:38.966062+0000","last_became_active":"2024-08-17T02:27:38.964171+0000","last_became_peered":"2024-08-17T02:27:38.964171+0000","last_unstale":"2024-08-17T02:27:38.966062+0000","last_undegraded":"2024-08-17T02:27:38.966062+0000","last_fullsized":"2024-08-17T02:27:38.966062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:23.189091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221364+0000","last_change":"2024-08-17T02:27:38.231746+0000","last_active":"2024-08-17T02:27:39.221364+0000","last_peered":"2024-08-17T02:27:39.221364+0000","last_clean":"2024-08-17T02:27:39.221364+0000","last_became_active":"2024-08-17T02:27:38.231403+0000","last_became_peered":"2024-08-17T02:27:38.231403+0000","last_unstale":"2024-08-17T02:27:39.221364+0000","last_undegraded":"2024-08-17T02:27:39.221364+0000","last_fullsized":"2024-08-17T02:27:39.221364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.966830+0000","last_change":"2024-08-17T02:27:38.965438+0000","last_active":"2024-08-17T02:27:38.966830+0000","last_peered":"2024-08-17T02:27:38.966830+0000","last_clean":"2024-08-17T02:27:38.966830+0000","last_became_active":"2024-08-17T02:27:38.964623+0000","last_became_peered":"2024-08-17T02:27:38.964623+0000","last_unstale":"2024-08-17T02:27:38.966830+0000","last_undegraded":"2024-08-17T02:27:38.966830+0000","last_fullsized":"2024-08-17T02:27:38.966830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222595+0000","last_change":"2024-08-17T02:27:38.235902+0000","last_active":"2024-08-17T02:27:39.222595+0000","last_peered":"2024-08-17T02:27:39.222595+0000","last_clean":"2024-08-17T02:27:39.222595+0000","last_became_active":"2024-08-17T02:27:38.235584+0000","last_became_peered":"2024-08-17T02:27:38.235584+0000","last_unstale":"2024-08-17T02:27:39.222595+0000","last_undegraded":"2024-08-17T02:27:39.222595+0000","last_fullsized":"2024-08-17T02:27:39.222595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962432+0000","last_change":"2024-08-17T02:27:38.952664+0000","last_active":"2024-08-17T02:27:38.962432+0000","last_peered":"2024-08-17T02:27:38.962432+0000","last_clean":"2024-08-17T02:27:38.962432+0000","last_became_active":"2024-08-17T02:27:38.952205+0000","last_became_peered":"2024-08-17T02:27:38.952205+0000","last_unstale":"2024-08-17T02:27:38.962432+0000","last_undegraded":"2024-08-17T02:27:38.962432+0000","last_fullsized":"2024-08-17T02:27:38.962432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:45:15.110165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935719+0000","last_change":"2024-08-17T02:27:38.231965+0000","last_active":"2024-08-17T02:27:38.935719+0000","last_peered":"2024-08-17T02:27:38.935719+0000","last_clean":"2024-08-17T02:27:38.935719+0000","last_became_active":"2024-08-17T02:27:38.231608+0000","last_became_peered":"2024-08-17T02:27:38.231608+0000","last_unstale":"2024-08-17T02:27:38.935719+0000","last_undegraded":"2024-08-17T02:27:38.935719+0000","last_fullsized":"2024-08-17T02:27:38.935719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960138+0000","last_change":"2024-08-17T02:27:38.957545+0000","last_active":"2024-08-17T02:27:38.960138+0000","last_peered":"2024-08-17T02:27:38.960138+0000","last_clean":"2024-08-17T02:27:38.960138+0000","last_became_active":"2024-08-17T02:27:38.956306+0000","last_became_peered":"2024-08-17T02:27:38.956306+0000","last_unstale":"2024-08-17T02:27:38.960138+0000","last_undegraded":"2024-08-17T02:27:38.960138+0000","last_fullsized":"2024-08-17T02:27:38.960138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:51.028742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937438+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:27:38.937438+0000","last_peered":"2024-08-17T02:27:38.937438+0000","last_clean":"2024-08-17T02:27:38.937438+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:27:38.937438+0000","last_undegraded":"2024-08-17T02:27:38.937438+0000","last_fullsized":"2024-08-17T02:27:38.937438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.935661+0000","last_change":"2024-08-17T02:27:38.221994+0000","last_active":"2024-08-17T02:27:38.935661+0000","last_peered":"2024-08-17T02:27:38.935661+0000","last_clean":"2024-08-17T02:27:38.935661+0000","last_became_active":"2024-08-17T02:27:38.221630+0000","last_became_peered":"2024-08-17T02:27:38.221630+0000","last_unstale":"2024-08-17T02:27:38.935661+0000","last_undegraded":"2024-08-17T02:27:38.935661+0000","last_fullsized":"2024-08-17T02:27:38.935661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.952005+0000","last_change":"2024-08-17T02:27:38.948764+0000","last_active":"2024-08-17T02:27:38.952005+0000","last_peered":"2024-08-17T02:27:38.952005+0000","last_clean":"2024-08-17T02:27:38.952005+0000","last_became_active":"2024-08-17T02:27:38.948461+0000","last_became_peered":"2024-08-17T02:27:38.948461+0000","last_unstale":"2024-08-17T02:27:38.952005+0000","last_undegraded":"2024-08-17T02:27:38.952005+0000","last_fullsized":"2024-08-17T02:27:38.952005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:53:00.812685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937276+0000","last_change":"2024-08-17T02:27:38.227208+0000","last_active":"2024-08-17T02:27:38.937276+0000","last_peered":"2024-08-17T02:27:38.937276+0000","last_clean":"2024-08-17T02:27:38.937276+0000","last_became_active":"2024-08-17T02:27:38.226945+0000","last_became_peered":"2024-08-17T02:27:38.226945+0000","last_unstale":"2024-08-17T02:27:38.937276+0000","last_undegraded":"2024-08-17T02:27:38.937276+0000","last_fullsized":"2024-08-17T02:27:38.937276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961809+0000","last_change":"2024-08-17T02:27:38.961180+0000","last_active":"2024-08-17T02:27:38.961809+0000","last_peered":"2024-08-17T02:27:38.961809+0000","last_clean":"2024-08-17T02:27:38.961809+0000","last_became_active":"2024-08-17T02:27:38.960913+0000","last_became_peered":"2024-08-17T02:27:38.960913+0000","last_unstale":"2024-08-17T02:27:38.961809+0000","last_undegraded":"2024-08-17T02:27:38.961809+0000","last_fullsized":"2024-08-17T02:27:38.961809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:38:59.847771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.934691+0000","last_change":"2024-08-17T02:27:38.234380+0000","last_active":"2024-08-17T02:27:38.934691+0000","last_peered":"2024-08-17T02:27:38.934691+0000","last_clean":"2024-08-17T02:27:38.934691+0000","last_became_active":"2024-08-17T02:27:38.233537+0000","last_became_peered":"2024-08-17T02:27:38.233537+0000","last_unstale":"2024-08-17T02:27:38.934691+0000","last_undegraded":"2024-08-17T02:27:38.934691+0000","last_fullsized":"2024-08-17T02:27:38.934691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:02.843468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943563+0000","last_change":"2024-08-17T02:27:38.940399+0000","last_active":"2024-08-17T02:27:38.943563+0000","last_peered":"2024-08-17T02:27:38.943563+0000","last_clean":"2024-08-17T02:27:38.943563+0000","last_became_active":"2024-08-17T02:27:38.939407+0000","last_became_peered":"2024-08-17T02:27:38.939407+0000","last_unstale":"2024-08-17T02:27:38.943563+0000","last_undegraded":"2024-08-17T02:27:38.943563+0000","last_fullsized":"2024-08-17T02:27:38.943563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937108+0000","last_change":"2024-08-17T02:27:38.236139+0000","last_active":"2024-08-17T02:27:38.937108+0000","last_peered":"2024-08-17T02:27:38.937108+0000","last_clean":"2024-08-17T02:27:38.937108+0000","last_became_active":"2024-08-17T02:27:38.235906+0000","last_became_peered":"2024-08-17T02:27:38.235906+0000","last_unstale":"2024-08-17T02:27:38.937108+0000","last_undegraded":"2024-08-17T02:27:38.937108+0000","last_fullsized":"2024-08-17T02:27:38.937108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.961622+0000","last_change":"2024-08-17T02:27:38.955645+0000","last_active":"2024-08-17T02:27:38.961622+0000","last_peered":"2024-08-17T02:27:38.961622+0000","last_clean":"2024-08-17T02:27:38.961622+0000","last_became_active":"2024-08-17T02:27:38.955312+0000","last_became_peered":"2024-08-17T02:27:38.955312+0000","last_unstale":"2024-08-17T02:27:38.961622+0000","last_undegraded":"2024-08-17T02:27:38.961622+0000","last_fullsized":"2024-08-17T02:27:38.961622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:47.735557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932702+0000","last_change":"2024-08-17T02:27:38.237877+0000","last_active":"2024-08-17T02:27:38.932702+0000","last_peered":"2024-08-17T02:27:38.932702+0000","last_clean":"2024-08-17T02:27:38.932702+0000","last_became_active":"2024-08-17T02:27:38.237636+0000","last_became_peered":"2024-08-17T02:27:38.237636+0000","last_unstale":"2024-08-17T02:27:38.932702+0000","last_undegraded":"2024-08-17T02:27:38.932702+0000","last_fullsized":"2024-08-17T02:27:38.932702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:36:41.489013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.954404+0000","last_change":"2024-08-17T02:27:38.950989+0000","last_active":"2024-08-17T02:27:38.954404+0000","last_peered":"2024-08-17T02:27:38.954404+0000","last_clean":"2024-08-17T02:27:38.954404+0000","last_became_active":"2024-08-17T02:27:38.950684+0000","last_became_peered":"2024-08-17T02:27:38.950684+0000","last_unstale":"2024-08-17T02:27:38.954404+0000","last_undegraded":"2024-08-17T02:27:38.954404+0000","last_fullsized":"2024-08-17T02:27:38.954404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.938295+0000","last_change":"2024-08-17T02:27:38.229546+0000","last_active":"2024-08-17T02:27:38.938295+0000","last_peered":"2024-08-17T02:27:38.938295+0000","last_clean":"2024-08-17T02:27:38.938295+0000","last_became_active":"2024-08-17T02:27:38.229068+0000","last_became_peered":"2024-08-17T02:27:38.229068+0000","last_unstale":"2024-08-17T02:27:38.938295+0000","last_undegraded":"2024-08-17T02:27:38.938295+0000","last_fullsized":"2024-08-17T02:27:38.938295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:42.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.943796+0000","last_change":"2024-08-17T02:27:38.940534+0000","last_active":"2024-08-17T02:27:38.943796+0000","last_peered":"2024-08-17T02:27:38.943796+0000","last_clean":"2024-08-17T02:27:38.943796+0000","last_became_active":"2024-08-17T02:27:38.940214+0000","last_became_peered":"2024-08-17T02:27:38.940214+0000","last_unstale":"2024-08-17T02:27:38.943796+0000","last_undegraded":"2024-08-17T02:27:38.943796+0000","last_fullsized":"2024-08-17T02:27:38.943796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:52:21.156900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:27:40.448068+0000","last_change":"2024-08-17T02:27:38.232881+0000","last_active":"2024-08-17T02:27:40.448068+0000","last_peered":"2024-08-17T02:27:40.448068+0000","last_clean":"2024-08-17T02:27:40.448068+0000","last_became_active":"2024-08-17T02:27:38.232605+0000","last_became_peered":"2024-08-17T02:27:38.232605+0000","last_unstale":"2024-08-17T02:27:40.448068+0000","last_undegraded":"2024-08-17T02:27:40.448068+0000","last_fullsized":"2024-08-17T02:27:40.448068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965104+0000","last_change":"2024-08-17T02:27:38.964318+0000","last_active":"2024-08-17T02:27:38.965104+0000","last_peered":"2024-08-17T02:27:38.965104+0000","last_clean":"2024-08-17T02:27:38.965104+0000","last_became_active":"2024-08-17T02:27:38.964068+0000","last_became_peered":"2024-08-17T02:27:38.964068+0000","last_unstale":"2024-08-17T02:27:38.965104+0000","last_undegraded":"2024-08-17T02:27:38.965104+0000","last_fullsized":"2024-08-17T02:27:38.965104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:08.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220792+0000","last_change":"2024-08-17T02:27:38.233166+0000","last_active":"2024-08-17T02:27:39.220792+0000","last_peered":"2024-08-17T02:27:39.220792+0000","last_clean":"2024-08-17T02:27:39.220792+0000","last_became_active":"2024-08-17T02:27:38.232772+0000","last_became_peered":"2024-08-17T02:27:38.232772+0000","last_unstale":"2024-08-17T02:27:39.220792+0000","last_undegraded":"2024-08-17T02:27:39.220792+0000","last_fullsized":"2024-08-17T02:27:39.220792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:33.977641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950572+0000","last_change":"2024-08-17T02:27:38.947496+0000","last_active":"2024-08-17T02:27:38.950572+0000","last_peered":"2024-08-17T02:27:38.950572+0000","last_clean":"2024-08-17T02:27:38.950572+0000","last_became_active":"2024-08-17T02:27:38.945946+0000","last_became_peered":"2024-08-17T02:27:38.945946+0000","last_unstale":"2024-08-17T02:27:38.950572+0000","last_undegraded":"2024-08-17T02:27:38.950572+0000","last_fullsized":"2024-08-17T02:27:38.950572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:47.115838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.937161+0000","last_change":"2024-08-17T02:27:38.225331+0000","last_active":"2024-08-17T02:27:38.937161+0000","last_peered":"2024-08-17T02:27:38.937161+0000","last_clean":"2024-08-17T02:27:38.937161+0000","last_became_active":"2024-08-17T02:27:38.222853+0000","last_became_peered":"2024-08-17T02:27:38.222853+0000","last_unstale":"2024-08-17T02:27:38.937161+0000","last_undegraded":"2024-08-17T02:27:38.937161+0000","last_fullsized":"2024-08-17T02:27:38.937161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:18.555257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962392+0000","last_change":"2024-08-17T02:27:38.957489+0000","last_active":"2024-08-17T02:27:38.962392+0000","last_peered":"2024-08-17T02:27:38.962392+0000","last_clean":"2024-08-17T02:27:38.962392+0000","last_became_active":"2024-08-17T02:27:38.957214+0000","last_became_peered":"2024-08-17T02:27:38.957214+0000","last_unstale":"2024-08-17T02:27:38.962392+0000","last_undegraded":"2024-08-17T02:27:38.962392+0000","last_fullsized":"2024-08-17T02:27:38.962392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:19.557461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.932946+0000","last_change":"2024-08-17T02:27:38.234553+0000","last_active":"2024-08-17T02:27:38.932946+0000","last_peered":"2024-08-17T02:27:38.932946+0000","last_clean":"2024-08-17T02:27:38.932946+0000","last_became_active":"2024-08-17T02:27:38.234040+0000","last_became_peered":"2024-08-17T02:27:38.234040+0000","last_unstale":"2024-08-17T02:27:38.932946+0000","last_undegraded":"2024-08-17T02:27:38.932946+0000","last_fullsized":"2024-08-17T02:27:38.932946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.950101+0000","last_change":"2024-08-17T02:27:38.946873+0000","last_active":"2024-08-17T02:27:38.950101+0000","last_peered":"2024-08-17T02:27:38.950101+0000","last_clean":"2024-08-17T02:27:38.950101+0000","last_became_active":"2024-08-17T02:27:38.946553+0000","last_became_peered":"2024-08-17T02:27:38.946553+0000","last_unstale":"2024-08-17T02:27:38.950101+0000","last_undegraded":"2024-08-17T02:27:38.950101+0000","last_fullsized":"2024-08-17T02:27:38.950101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:57.756643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.933576+0000","last_change":"2024-08-17T02:27:38.235261+0000","last_active":"2024-08-17T02:27:38.933576+0000","last_peered":"2024-08-17T02:27:38.933576+0000","last_clean":"2024-08-17T02:27:38.933576+0000","last_became_active":"2024-08-17T02:27:38.234975+0000","last_became_peered":"2024-08-17T02:27:38.234975+0000","last_unstale":"2024-08-17T02:27:38.933576+0000","last_undegraded":"2024-08-17T02:27:38.933576+0000","last_fullsized":"2024-08-17T02:27:38.933576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.951870+0000","last_change":"2024-08-17T02:27:38.948237+0000","last_active":"2024-08-17T02:27:38.951870+0000","last_peered":"2024-08-17T02:27:38.951870+0000","last_clean":"2024-08-17T02:27:38.951870+0000","last_became_active":"2024-08-17T02:27:38.947980+0000","last_became_peered":"2024-08-17T02:27:38.947980+0000","last_unstale":"2024-08-17T02:27:38.951870+0000","last_undegraded":"2024-08-17T02:27:38.951870+0000","last_fullsized":"2024-08-17T02:27:38.951870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220208+0000","last_change":"2024-08-17T02:27:38.224385+0000","last_active":"2024-08-17T02:27:39.220208+0000","last_peered":"2024-08-17T02:27:39.220208+0000","last_clean":"2024-08-17T02:27:39.220208+0000","last_became_active":"2024-08-17T02:27:38.224112+0000","last_became_peered":"2024-08-17T02:27:38.224112+0000","last_unstale":"2024-08-17T02:27:39.220208+0000","last_undegraded":"2024-08-17T02:27:39.220208+0000","last_fullsized":"2024-08-17T02:27:39.220208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:24:01.908408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.960003+0000","last_change":"2024-08-17T02:27:38.958582+0000","last_active":"2024-08-17T02:27:38.960003+0000","last_peered":"2024-08-17T02:27:38.960003+0000","last_clean":"2024-08-17T02:27:38.960003+0000","last_became_active":"2024-08-17T02:27:38.958297+0000","last_became_peered":"2024-08-17T02:27:38.958297+0000","last_unstale":"2024-08-17T02:27:38.960003+0000","last_undegraded":"2024-08-17T02:27:38.960003+0000","last_fullsized":"2024-08-17T02:27:38.960003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.965620+0000","last_change":"2024-08-17T02:27:38.958334+0000","last_active":"2024-08-17T02:27:38.965620+0000","last_peered":"2024-08-17T02:27:38.965620+0000","last_clean":"2024-08-17T02:27:38.965620+0000","last_became_active":"2024-08-17T02:27:38.958023+0000","last_became_peered":"2024-08-17T02:27:38.958023+0000","last_unstale":"2024-08-17T02:27:38.965620+0000","last_undegraded":"2024-08-17T02:27:38.965620+0000","last_fullsized":"2024-08-17T02:27:38.965620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:51:06.126825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.221510+0000","last_change":"2024-08-17T02:27:38.227961+0000","last_active":"2024-08-17T02:27:39.221510+0000","last_peered":"2024-08-17T02:27:39.221510+0000","last_clean":"2024-08-17T02:27:39.221510+0000","last_became_active":"2024-08-17T02:27:38.227515+0000","last_became_peered":"2024-08-17T02:27:38.227515+0000","last_unstale":"2024-08-17T02:27:39.221510+0000","last_undegraded":"2024-08-17T02:27:39.221510+0000","last_fullsized":"2024-08-17T02:27:39.221510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:02:19.576921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.962441+0000","last_change":"2024-08-17T02:27:38.956122+0000","last_active":"2024-08-17T02:27:38.962441+0000","last_peered":"2024-08-17T02:27:38.962441+0000","last_clean":"2024-08-17T02:27:38.962441+0000","last_became_active":"2024-08-17T02:27:38.955849+0000","last_became_peered":"2024-08-17T02:27:38.955849+0000","last_unstale":"2024-08-17T02:27:38.962441+0000","last_undegraded":"2024-08-17T02:27:38.962441+0000","last_fullsized":"2024-08-17T02:27:38.962441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:41:03.568442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220743+0000","last_change":"2024-08-17T02:27:38.229758+0000","last_active":"2024-08-17T02:27:39.220743+0000","last_peered":"2024-08-17T02:27:39.220743+0000","last_clean":"2024-08-17T02:27:39.220743+0000","last_became_active":"2024-08-17T02:27:38.229308+0000","last_became_peered":"2024-08-17T02:27:38.229308+0000","last_unstale":"2024-08-17T02:27:39.220743+0000","last_undegraded":"2024-08-17T02:27:39.220743+0000","last_fullsized":"2024-08-17T02:27:39.220743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:13:46.733353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953549+0000","last_change":"2024-08-17T02:27:38.951247+0000","last_active":"2024-08-17T02:27:38.953549+0000","last_peered":"2024-08-17T02:27:38.953549+0000","last_clean":"2024-08-17T02:27:38.953549+0000","last_became_active":"2024-08-17T02:27:38.950979+0000","last_became_peered":"2024-08-17T02:27:38.950979+0000","last_unstale":"2024-08-17T02:27:38.953549+0000","last_undegraded":"2024-08-17T02:27:38.953549+0000","last_fullsized":"2024-08-17T02:27:38.953549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:12:13.804400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.220328+0000","last_change":"2024-08-17T02:27:38.231845+0000","last_active":"2024-08-17T02:27:39.220328+0000","last_peered":"2024-08-17T02:27:39.220328+0000","last_clean":"2024-08-17T02:27:39.220328+0000","last_became_active":"2024-08-17T02:27:38.231535+0000","last_became_peered":"2024-08-17T02:27:38.231535+0000","last_unstale":"2024-08-17T02:27:39.220328+0000","last_undegraded":"2024-08-17T02:27:39.220328+0000","last_fullsized":"2024-08-17T02:27:39.220328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:07.207222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:38.953028+0000","last_change":"2024-08-17T02:27:38.950278+0000","last_active":"2024-08-17T02:27:38.953028+0000","last_peered":"2024-08-17T02:27:38.953028+0000","last_clean":"2024-08-17T02:27:38.953028+0000","last_became_active":"2024-08-17T02:27:38.949470+0000","last_became_peered":"2024-08-17T02:27:38.949470+0000","last_unstale":"2024-08-17T02:27:38.953028+0000","last_undegraded":"2024-08-17T02:27:38.953028+0000","last_fullsized":"2024-08-17T02:27:38.953028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.202689+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.202689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:37.079111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:39.222977+0000","last_change":"2024-08-17T02:27:38.227009+0000","last_active":"2024-08-17T02:27:39.222977+0000","last_peered":"2024-08-17T02:27:39.222977+0000","last_clean":"2024-08-17T02:27:39.222977+0000","last_became_active":"2024-08-17T02:27:38.226613+0000","last_became_peered":"2024-08-17T02:27:38.226613+0000","last_unstale":"2024-08-17T02:27:39.222977+0000","last_undegraded":"2024-08-17T02:27:39.222977+0000","last_fullsized":"2024-08-17T02:27:39.222977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:37.200485+0000","last_clean_scrub_stamp":"2024-08-17T02:27:37.200485+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:54:36.242448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":815104,"data_stored":666251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301744,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070096,"statfs":{"total":96636764160,"available":96327778304,"internally_reserved":0,"allocated":229376,"data_stored":76865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301732,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070108,"statfs":{"total":96636764160,"available":96327790592,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302460,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069380,"statfs":{"total":96636764160,"available":96327045120,"internally_reserved":0,"allocated":823296,"data_stored":666307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:48.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:27:48.854 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:27:48.854 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:27:48.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:27:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.041+0000 7efd49a00640 1 Processor -- start 2024-08-17T02:27:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.041+0000 7efd49a00640 1 -- start start 2024-08-17T02:27:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.042+0000 7efd49a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 0x7efd440c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.042+0000 7efd49a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd440cb340 0x7efd441590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.042+0000 7efd49a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd440cb7c0 con 0x7efd44158ce0 2024-08-17T02:27:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.042+0000 7efd49a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd440cf0c0 con 0x7efd440cb340 2024-08-17T02:27:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.042+0000 7efd49a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd44089000 con 0x7efd440d08d0 2024-08-17T02:27:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.043+0000 7efd42a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7efd44158ce0 0x7efd440cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46110/0 (socket says 172.21.15.46:46110) 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.043+0000 7efd42a00640 1 -- 172.21.15.46:0/3470698540 learned_addr learned my addr 172.21.15.46:0/3470698540 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.043+0000 7efd43400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd440cb340 0x7efd441590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.043+0000 7efd42000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 0x7efd440c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd43400640 1 -- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 msgr2=0x7efd440c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd43400640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 0x7efd440c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd43400640 1 -- 172.21.15.46:0/3470698540 >> v1:172.21.15.162:6789/0 conn(0x7efd44158ce0 legacy=0x7efd440cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd43400640 1 -- 172.21.15.46:0/3470698540 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440ceb20 con 0x7efd440cb340 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd41600640 1 -- 172.21.15.46:0/3470698540 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144577152 0 0) 0x7efd440cb7c0 con 0x7efd44158ce0 2024-08-17T02:27:49.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.044+0000 7efd42000640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 0x7efd440c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.045+0000 7efd43400640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd441590b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009e90 tx=0x7efd3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6643e0924b8d1cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.045+0000 7efd41600640 1 -- 172.21.15.46:0/3470698540 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c007550 con 0x7efd440cb340 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.045+0000 7efd41600640 1 -- 172.21.15.46:0/3470698540 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c02d050 con 0x7efd440cb340 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.045+0000 7efd41600640 1 -- 172.21.15.46:0/3470698540 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0078e0 con 0x7efd440cb340 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 -- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 msgr2=0x7efd441590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd441590b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009e90 tx=0x7efd3c009780 comp rx=0 tx=0).stop 2024-08-17T02:27:49.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 -- 172.21.15.46:0/3470698540 shutdown_connections 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd440d08d0 0x7efd440c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 --2- 172.21.15.46:0/3470698540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd441590b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 -- 172.21.15.46:0/3470698540 >> 172.21.15.46:0/3470698540 conn(0x7efd440cfdc0 msgr2=0x7efd440d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 -- 172.21.15.46:0/3470698540 shutdown_connections 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.046+0000 7efd49a00640 1 -- 172.21.15.46:0/3470698540 wait complete. 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.047+0000 7efd49a00640 1 Processor -- start 2024-08-17T02:27:49.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.047+0000 7efd49a00640 1 -- start start 2024-08-17T02:27:49.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd4414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd44158ce0 0x7efd4414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd44153fa0 con 0x7efd440d08d0 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4414fc00 con 0x7efd440cb340 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.048+0000 7efd49a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd44152550 con 0x7efd44158ce0 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40932/0 (socket says 172.21.15.46:40932) 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 -- 172.21.15.46:0/3549881197 learned_addr learned my addr 172.21.15.46:0/3549881197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd43400640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd44158ce0 0x7efd4414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd4414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 -- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd44158ce0 msgr2=0x7efd4414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd44158ce0 0x7efd4414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 -- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 msgr2=0x7efd4414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd4414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 -- 172.21.15.46:0/3549881197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30009390 con 0x7efd440d08d0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd4414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.049+0000 7efd42000640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd3000ec80 tx=0x7efd300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.050+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000eec0 con 0x7efd440d08d0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.050+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3000cbc0 con 0x7efd440d08d0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.050+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30013470 con 0x7efd440d08d0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.050+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c009a20 con 0x7efd440d08d0 2024-08-17T02:27:49.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.050+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd44154500 con 0x7efd440d08d0 2024-08-17T02:27:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.051+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd44064db0 con 0x7efd440d08d0 2024-08-17T02:27:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.052+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd300137e0 con 0x7efd440d08d0 2024-08-17T02:27:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.052+0000 7efd3a000640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 0x7efd24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.053+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efd30082840 con 0x7efd440d08d0 2024-08-17T02:27:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.053+0000 7efd42a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 0x7efd24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.053+0000 7efd42a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 0x7efd24067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd340011e0 tx=0x7efd34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.056+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd30050910 con 0x7efd440d08d0 2024-08-17T02:27:49.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.276+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efd440b4070 con 0x7efd440d08d0 2024-08-17T02:27:49.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.277+0000 7efd3a000640 1 -- 172.21.15.46:0/3549881197 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efd30053f30 con 0x7efd440d08d0 2024-08-17T02:27:49.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:49.277 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:27:49.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 msgr2=0x7efd24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 0x7efd24067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd340011e0 tx=0x7efd34009040 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 msgr2=0x7efd440b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd3000ec80 tx=0x7efd300090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 shutdown_connections 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd24065150 0x7efd24067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd44158ce0 0x7efd4414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd440d08d0 0x7efd440b3b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 --2- 172.21.15.46:0/3549881197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd440cb340 0x7efd4414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 >> 172.21.15.46:0/3549881197 conn(0x7efd440cfdc0 msgr2=0x7efd44156600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 shutdown_connections 2024-08-17T02:27:49.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.279+0000 7efd49a00640 1 -- 172.21.15.46:0/3549881197 wait complete. 2024-08-17T02:27:49.294 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:27:49.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.445+0000 7fa948400640 1 Processor -- start 2024-08-17T02:27:49.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.445+0000 7fa948400640 1 -- start start 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.446+0000 7fa948400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9401401b0 0x7fa9400caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.446+0000 7fa948400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9400caa80 con 0x7fa940140580 2024-08-17T02:27:49.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.446+0000 7fa948400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9400c9e70 con 0x7fa9400b1440 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.446+0000 7fa948400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9400cb450 con 0x7fa9401401b0 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9401401b0 0x7fa9400caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa9401401b0 0x7fa9400caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40934/0 (socket says 172.21.15.46:40934) 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 -- 172.21.15.46:0/2739525536 learned_addr learned my addr 172.21.15.46:0/2739525536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945000640 1 --1- 172.21.15.46:0/2739525536 >> v1:172.21.15.46:6789/0 conn(0x7fa940140580 0x7fa9400b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38816/0 (socket says 172.21.15.46:38816) 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 -- 172.21.15.46:0/2739525536 >> v1:172.21.15.162:6789/0 conn(0x7fa9400b1440 legacy=0x7fa9400c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 -- 172.21.15.46:0/2739525536 >> v1:172.21.15.46:6789/0 conn(0x7fa940140580 legacy=0x7fa9400b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.447+0000 7fa945a00640 1 -- 172.21.15.46:0/2739525536 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400ca150 con 0x7fa9401401b0 2024-08-17T02:27:49.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.448+0000 7fa945a00640 1 --2- 172.21.15.46:0/2739525536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400caf10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa934009910 tx=0x7fa9340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9129afa64b1b687 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.448+0000 7fa93fe00640 1 -- 172.21.15.46:0/2739525536 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93402ae60 con 0x7fa9401401b0 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.448+0000 7fa93fe00640 1 -- 172.21.15.46:0/2739525536 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934032440 con 0x7fa9401401b0 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.448+0000 7fa93fe00640 1 -- 172.21.15.46:0/2739525536 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340327e0 con 0x7fa9401401b0 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 -- 172.21.15.46:0/2739525536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 msgr2=0x7fa9400caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 --2- 172.21.15.46:0/2739525536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400caf10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa934009910 tx=0x7fa9340091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 -- 172.21.15.46:0/2739525536 shutdown_connections 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 --2- 172.21.15.46:0/2739525536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400caf10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 -- 172.21.15.46:0/2739525536 >> 172.21.15.46:0/2739525536 conn(0x7fa9400cb9b0 msgr2=0x7fa9400cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 -- 172.21.15.46:0/2739525536 shutdown_connections 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.449+0000 7fa948400640 1 -- 172.21.15.46:0/2739525536 wait complete. 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.450+0000 7fa948400640 1 Processor -- start 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 -- start start 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9400b1440 0x7fa940133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940140580 0x7fa9400c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94013e7d0 con 0x7fa9401401b0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94015be90 con 0x7fa940140580 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.451+0000 7fa948400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400b0b10 con 0x7fa9400b1440 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40940/0 (socket says 172.21.15.46:40940) 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 -- 172.21.15.46:0/1626008414 learned_addr learned my addr 172.21.15.46:0/1626008414 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945a00640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9400b1440 0x7fa940133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa946400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940140580 0x7fa9400c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 -- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9400b1440 msgr2=0x7fa940133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9400b1440 0x7fa940133150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 -- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940140580 msgr2=0x7fa9400c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940140580 0x7fa9400c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 -- 172.21.15.46:0/1626008414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009450 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.452+0000 7fa945000640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00c590 tx=0x7fa92c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.453+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c007300 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.453+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c0074a0 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.453+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0047a0 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.453+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94015b560 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.453+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94015bb20 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.454+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa940064630 con 0x7fa9401401b0 2024-08-17T02:27:49.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.455+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa92c004bd0 con 0x7fa9401401b0 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.455+0000 7fa93cc00640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 0x7fa920067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.456+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa92c081430 con 0x7fa9401401b0 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.456+0000 7fa945a00640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 0x7fa920067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.457+0000 7fa945a00640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 0x7fa920067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa934034000 tx=0x7fa934032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.459+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa92c04be40 con 0x7fa9401401b0 2024-08-17T02:27:49.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.642+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa940064db0 con 0x7fa9401401b0 2024-08-17T02:27:49.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.643+0000 7fa93cc00640 1 -- 172.21.15.46:0/1626008414 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa92c053010 con 0x7fa9401401b0 2024-08-17T02:27:49.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:49.643 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 msgr2=0x7fa920067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 0x7fa920067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa934034000 tx=0x7fa934032000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 msgr2=0x7fa9400c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00c590 tx=0x7fa92c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 shutdown_connections 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa940140580 0x7fa9400c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9401401b0 0x7fa9400c6890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa920065150 0x7fa920067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 --2- 172.21.15.46:0/1626008414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9400b1440 0x7fa940133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 >> 172.21.15.46:0/1626008414 conn(0x7fa9400cb9b0 msgr2=0x7fa94013ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 shutdown_connections 2024-08-17T02:27:49.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.645+0000 7fa948400640 1 -- 172.21.15.46:0/1626008414 wait complete. 2024-08-17T02:27:49.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:49.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.813+0000 7f6b73000640 1 Processor -- start 2024-08-17T02:27:49.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.813+0000 7f6b73000640 1 -- start start 2024-08-17T02:27:49.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b73000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b73000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0af5f0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b73000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c159600 con 0x7f6b6c06df00 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b73000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1598e0 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b72600640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6b6c0ab010 0x7f6b6c0ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43328/0 (socket says 172.21.15.46:43328) 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b72600640 1 -- 172.21.15.46:0/323982587 learned_addr learned my addr 172.21.15.46:0/323982587 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:49.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b71200640 1 --2- 172.21.15.46:0/323982587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475513698 0 0) 0x7f6b6c0af5f0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b540034e0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235394520 0 0) 0x7f6b6c159600 con 0x7f6b6c06df00 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c0af5f0 con 0x7f6b6c06df00 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.815+0000 7f6b71200640 1 -- 172.21.15.46:0/323982587 >> v1:172.21.15.162:6789/0 conn(0x7f6b6c06df00 legacy=0x7f6b6c0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.816+0000 7f6b71200640 1 -- 172.21.15.46:0/323982587 >> v1:172.21.15.46:6789/0 conn(0x7f6b6c0ab010 legacy=0x7f6b6c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.816+0000 7f6b71200640 1 -- 172.21.15.46:0/323982587 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c159bc0 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b71200640 1 --2- 172.21.15.46:0/323982587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c06e2d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009880 tx=0x7f6b580090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdeb0b35acb1b634 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5802ae10 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58032440 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b6be00640 1 -- 172.21.15.46:0/323982587 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580327e0 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b73000640 1 -- 172.21.15.46:0/323982587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 msgr2=0x7f6b6c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.817+0000 7f6b73000640 1 --2- 172.21.15.46:0/323982587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c06e2d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009880 tx=0x7f6b580090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.818+0000 7f6b73000640 1 -- 172.21.15.46:0/323982587 shutdown_connections 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.818+0000 7f6b73000640 1 --2- 172.21.15.46:0/323982587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c06e2d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.818+0000 7f6b73000640 1 -- 172.21.15.46:0/323982587 >> 172.21.15.46:0/323982587 conn(0x7f6b6c067750 msgr2=0x7f6b6c06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.818+0000 7f6b73000640 1 -- 172.21.15.46:0/323982587 shutdown_connections 2024-08-17T02:27:49.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.818+0000 7f6b73000640 1 -- 172.21.15.46:0/323982587 wait complete. 2024-08-17T02:27:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.819+0000 7f6b73000640 1 Processor -- start 2024-08-17T02:27:49.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.819+0000 7f6b73000640 1 -- start start 2024-08-17T02:27:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 0x7f6b6c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ad750 con 0x7f6b6c0ab010 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ad190 con 0x7f6b6c06df00 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b73000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0ad470 con 0x7f6b6c15a0e0 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b71200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b71200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60628/0 (socket says 172.21.15.46:60628) 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.820+0000 7f6b71200640 1 -- 172.21.15.46:0/3273849013 learned_addr learned my addr 172.21.15.46:0/3273849013 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71c00640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 0x7f6b6c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b72600640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 -- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 msgr2=0x7f6b6c169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 -- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 msgr2=0x7f6b6c155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 0x7f6b6c155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 -- 172.21.15.46:0/3273849013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58009390 con 0x7f6b6c0ab010 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71c00640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 0x7f6b6c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b71200640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009880 tx=0x7f6b58032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58000c40 con 0x7f6b6c0ab010 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.821+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58031a60 con 0x7f6b6c0ab010 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.822+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c0ab4d0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.822+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58031e20 con 0x7f6b6c0ab010 2024-08-17T02:27:49.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.822+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c156410 con 0x7f6b6c0ab010 2024-08-17T02:27:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.823+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c1565a0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.823+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6b5803c400 con 0x7f6b6c0ab010 2024-08-17T02:27:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.824+0000 7f6b68c00640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 0x7f6b4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.824+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b580a28a0 con 0x7f6b6c0ab010 2024-08-17T02:27:49.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.825+0000 7f6b71c00640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 0x7f6b4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.825+0000 7f6b71c00640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 0x7f6b4c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b60003900 tx=0x7f6b60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:49.828+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b6c1565a0 con 0x7f6b6c0ab010 2024-08-17T02:27:50.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.009+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b6c1565a0 con 0x7f6b6c0ab010 2024-08-17T02:27:50.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.009+0000 7f6b68c00640 1 -- 172.21.15.46:0/3273849013 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b6c1565a0 con 0x7f6b6c0ab010 2024-08-17T02:27:50.009 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 msgr2=0x7f6b4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 0x7f6b4c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b60003900 tx=0x7f6b60009040 comp rx=0 tx=0).stop 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 msgr2=0x7f6b6c0abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009880 tx=0x7f6b58032000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 shutdown_connections 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6b4c065150 0x7f6b4c067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b6c15a0e0 0x7f6b6c169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b6c0ab010 0x7f6b6c0abcb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 --2- 172.21.15.46:0/3273849013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b6c06df00 0x7f6b6c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 >> 172.21.15.46:0/3273849013 conn(0x7f6b6c067750 msgr2=0x7f6b6c151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 shutdown_connections 2024-08-17T02:27:50.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.011+0000 7f6b73000640 1 -- 172.21.15.46:0/3273849013 wait complete. 2024-08-17T02:27:50.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.179+0000 7fa533600640 1 Processor -- start 2024-08-17T02:27:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.179+0000 7fa533600640 1 -- start start 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa533600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa52c155a80 0x7fa52c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa533600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c92e0 0x7fa52c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa533600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52c1598f0 con 0x7fa52c0c7db0 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa533600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52c159bd0 con 0x7fa52c155a80 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa533600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c159eb0 con 0x7fa52c0c92e0 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa530c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa52c155a80 0x7fa52c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa52be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa52c0c7db0 0x7fa52c0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43334/0 (socket says 172.21.15.46:43334) 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.180+0000 7fa52be00640 1 -- 172.21.15.46:0/2944861487 learned_addr learned my addr 172.21.15.46:0/2944861487 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa531600640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c92e0 0x7fa52c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa52b400640 1 -- 172.21.15.46:0/2944861487 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224116817 0 0) 0x7fa52c1598f0 con 0x7fa52c0c7db0 2024-08-17T02:27:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa530c00640 1 -- 172.21.15.46:0/2944861487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c92e0 msgr2=0x7fa52c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa530c00640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c92e0 0x7fa52c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa530c00640 1 -- 172.21.15.46:0/2944861487 >> v1:172.21.15.46:6789/0 conn(0x7fa52c0c7db0 legacy=0x7fa52c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.181+0000 7fa530c00640 1 -- 172.21.15.46:0/2944861487 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c15a190 con 0x7fa52c155a80 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.182+0000 7fa530c00640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c155a80 0x7fa52c06dc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa520009850 tx=0x7fa5200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae8bc273f90b24d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.182+0000 7fa52b400640 1 -- 172.21.15.46:0/2944861487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52002ae10 con 0x7fa52c155a80 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.182+0000 7fa52b400640 1 -- 172.21.15.46:0/2944861487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa520032440 con 0x7fa52c155a80 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.182+0000 7fa52b400640 1 -- 172.21.15.46:0/2944861487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200327e0 con 0x7fa52c155a80 2024-08-17T02:27:50.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 -- 172.21.15.46:0/2944861487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c155a80 msgr2=0x7fa52c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c155a80 0x7fa52c06dc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa520009850 tx=0x7fa5200090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 -- 172.21.15.46:0/2944861487 shutdown_connections 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c92e0 0x7fa52c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 --2- 172.21.15.46:0/2944861487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c155a80 0x7fa52c06dc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 -- 172.21.15.46:0/2944861487 >> 172.21.15.46:0/2944861487 conn(0x7fa52c067750 msgr2=0x7fa52c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 -- 172.21.15.46:0/2944861487 shutdown_connections 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.183+0000 7fa533600640 1 -- 172.21.15.46:0/2944861487 wait complete. 2024-08-17T02:27:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.184+0000 7fa533600640 1 Processor -- start 2024-08-17T02:27:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.185+0000 7fa533600640 1 -- start start 2024-08-17T02:27:50.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.185+0000 7fa533600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c7db0 0x7fa52c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.185+0000 7fa533600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa533600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa52c155a80 0x7fa52c13b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa533600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c155270 con 0x7fa52c0c92e0 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa533600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c154de0 con 0x7fa52c155a80 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa533600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52c1544b0 con 0x7fa52c0c7db0 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60646/0 (socket says 172.21.15.46:60646) 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 -- 172.21.15.46:0/3038995164 learned_addr learned my addr 172.21.15.46:0/3038995164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa530c00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c7db0 0x7fa52c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa531600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa52c155a80 0x7fa52c13b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 -- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c7db0 msgr2=0x7fa52c0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c7db0 0x7fa52c0af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 -- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa52c155a80 msgr2=0x7fa52c13b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa52c155a80 0x7fa52c13b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 -- 172.21.15.46:0/3038995164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520009390 con 0x7fa52c0c92e0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.186+0000 7fa52be00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c590 tx=0x7fa518007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.187+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518005aa0 con 0x7fa52c0c92e0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.187+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518005c00 con 0x7fa52c0c92e0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.187+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52c154790 con 0x7fa52c0c92e0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.187+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180070f0 con 0x7fa52c0c92e0 2024-08-17T02:27:50.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.187+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52c154160 con 0x7fa52c0c92e0 2024-08-17T02:27:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.188+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c154f70 con 0x7fa52c0c92e0 2024-08-17T02:27:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.189+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa518007520 con 0x7fa52c0c92e0 2024-08-17T02:27:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.189+0000 7fa51fe00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 0x7fa50c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.190+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa518081ec0 con 0x7fa52c0c92e0 2024-08-17T02:27:50.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.190+0000 7fa530c00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 0x7fa50c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.191+0000 7fa530c00640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 0x7fa50c067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa520034000 tx=0x7fa520032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.194+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa51804ff60 con 0x7fa52c0c92e0 2024-08-17T02:27:50.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.375+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa52c071050 con 0x7fa52c0c92e0 2024-08-17T02:27:50.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.376+0000 7fa51fe00640 1 -- 172.21.15.46:0/3038995164 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa518053580 con 0x7fa52c0c92e0 2024-08-17T02:27:50.376 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:27:50.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 msgr2=0x7fa50c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 0x7fa50c067630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa520034000 tx=0x7fa520032000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 msgr2=0x7fa52c13ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c590 tx=0x7fa518007d20 comp rx=0 tx=0).stop 2024-08-17T02:27:50.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 shutdown_connections 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa52c155a80 0x7fa52c13b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa52c0c92e0 0x7fa52c13ae20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa50c065180 0x7fa50c067630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 --2- 172.21.15.46:0/3038995164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa52c0c7db0 0x7fa52c0af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 >> 172.21.15.46:0/3038995164 conn(0x7fa52c067750 msgr2=0x7fa52c068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 shutdown_connections 2024-08-17T02:27:50.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.378+0000 7fa533600640 1 -- 172.21.15.46:0/3038995164 wait complete. 2024-08-17T02:27:50.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:50.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.548+0000 7f421c000640 1 Processor -- start 2024-08-17T02:27:50.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.548+0000 7f421c000640 1 -- start start 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f421c000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4214155a80 0x7f421406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f421c000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42140c7db0 0x7f42140c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f421c000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42141598f0 con 0x7f4214155e50 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f421c000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4214159bd0 con 0x7f4214155a80 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f421c000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4214159eb0 con 0x7f42140c7db0 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f4219600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4214155a80 0x7f421406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f4219600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4214155a80 0x7f421406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60648/0 (socket says 172.21.15.46:60648) 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.549+0000 7f4219600640 1 -- 172.21.15.46:0/984264779 learned_addr learned my addr 172.21.15.46:0/984264779 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.550+0000 7f4218c00640 1 --2- 172.21.15.46:0/984264779 >> v2:172.21.15.162:3300/0 conn(0x7f42140c7db0 0x7f42140c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.550+0000 7f4219600640 1 -- 172.21.15.46:0/984264779 >> v2:172.21.15.162:3300/0 conn(0x7f42140c7db0 msgr2=0x7f42140c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.550+0000 7f4219600640 1 --2- 172.21.15.46:0/984264779 >> v2:172.21.15.162:3300/0 conn(0x7f42140c7db0 0x7f42140c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.550+0000 7f4219600640 1 -- 172.21.15.46:0/984264779 >> v1:172.21.15.162:6789/0 conn(0x7f4214155e50 legacy=0x7f421406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.550+0000 7f4219600640 1 -- 172.21.15.46:0/984264779 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421415a190 con 0x7f4214155a80 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.551+0000 7f4219600640 1 --2- 172.21.15.46:0/984264779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155a80 0x7f421406dc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f421406c750 tx=0x7f42080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802767cc3583b3f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.551+0000 7f4213e00640 1 -- 172.21.15.46:0/984264779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208032440 con 0x7f4214155a80 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.551+0000 7f4213e00640 1 -- 172.21.15.46:0/984264779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080325a0 con 0x7f4214155a80 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.551+0000 7f4213e00640 1 -- 172.21.15.46:0/984264779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208032980 con 0x7f4214155a80 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 -- 172.21.15.46:0/984264779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155a80 msgr2=0x7f421406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 --2- 172.21.15.46:0/984264779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155a80 0x7f421406dc00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f421406c750 tx=0x7f42080091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 -- 172.21.15.46:0/984264779 shutdown_connections 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 --2- 172.21.15.46:0/984264779 >> v2:172.21.15.162:3300/0 conn(0x7f42140c7db0 0x7f42140c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 --2- 172.21.15.46:0/984264779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155a80 0x7f421406dc00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 -- 172.21.15.46:0/984264779 >> 172.21.15.46:0/984264779 conn(0x7f4214067750 msgr2=0x7f42140c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 -- 172.21.15.46:0/984264779 shutdown_connections 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.552+0000 7f421c000640 1 -- 172.21.15.46:0/984264779 wait complete. 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.553+0000 7f421c000640 1 Processor -- start 2024-08-17T02:27:50.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.553+0000 7f421c000640 1 -- start start 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42140c7db0 0x7f4214141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4214155a80 0x7f421412d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214141e70 con 0x7f4214155e50 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214148280 con 0x7f42140c7db0 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.554+0000 7f421c000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4214148560 con 0x7f4214155a80 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60660/0 (socket says 172.21.15.46:60660) 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 -- 172.21.15.46:0/1570214159 learned_addr learned my addr 172.21.15.46:0/1570214159 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:50.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f4219600640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42140c7db0 0x7f4214141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f4218c00640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4214155a80 0x7f421412d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 -- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4214155a80 msgr2=0x7f421412d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4214155a80 0x7f421412d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 -- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42140c7db0 msgr2=0x7f4214141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42140c7db0 0x7f4214141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 -- 172.21.15.46:0/1570214159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208009450 con 0x7f4214155e50 2024-08-17T02:27:50.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f421a000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f420c00c7c0 tx=0x7f420c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.555+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00a6d0 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.556+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c00a850 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.556+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c00ac10 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.556+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4214148840 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.556+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4214148e00 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.557+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4214071050 con 0x7f4214155e50 2024-08-17T02:27:50.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.557+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f420c003030 con 0x7f4214155e50 2024-08-17T02:27:50.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.559+0000 7f4210c00640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 0x7f41f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.559+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f420c0822e0 con 0x7f4214155e50 2024-08-17T02:27:50.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.559+0000 7f4219600640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 0x7f41f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.560+0000 7f4219600640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 0x7f41f4067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4208034000 tx=0x7f4208032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.563+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f420c050430 con 0x7f4214155e50 2024-08-17T02:27:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.748+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42140aa380 con 0x7f4214155e50 2024-08-17T02:27:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.748+0000 7f4210c00640 1 -- 172.21.15.46:0/1570214159 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f420c053a50 con 0x7f4214155e50 2024-08-17T02:27:50.748 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:27:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 msgr2=0x7f41f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 0x7f41f4067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4208034000 tx=0x7f4208032000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 msgr2=0x7f4214149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f420c00c7c0 tx=0x7f420c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 shutdown_connections 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4214155e50 0x7f4214149320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f41f4065150 0x7f41f4067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4214155a80 0x7f421412d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 --2- 172.21.15.46:0/1570214159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42140c7db0 0x7f4214141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 >> 172.21.15.46:0/1570214159 conn(0x7f4214067750 msgr2=0x7f42140c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 shutdown_connections 2024-08-17T02:27:50.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.750+0000 7f421c000640 1 -- 172.21.15.46:0/1570214159 wait complete. 2024-08-17T02:27:50.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.916+0000 7f22e8c00640 1 Processor -- start 2024-08-17T02:27:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.916+0000 7f22e8c00640 1 -- start start 2024-08-17T02:27:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e4155a20 0x7f22e40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e8c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22e4155df0 0x7f22e40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e8c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e4156670 con 0x7f22e406d7f0 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e8c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40b0350 con 0x7f22e4155df0 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e406e5e0 con 0x7f22e4155a20 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.917+0000 7f22e2800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f22e406d7f0 0x7f22e40ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43350/0 (socket says 172.21.15.46:43350) 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e2800640 1 -- 172.21.15.46:0/267076552 learned_addr learned my addr 172.21.15.46:0/267076552 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1e00640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e4155a20 0x7f22e40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1400640 1 --2- 172.21.15.46:0/267076552 >> v2:172.21.15.162:3300/0 conn(0x7f22e4155df0 0x7f22e40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e0a00640 1 -- 172.21.15.46:0/267076552 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744350873 0 0) 0x7f22e4156670 con 0x7f22e406d7f0 2024-08-17T02:27:50.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e0a00640 1 -- 172.21.15.46:0/267076552 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c80034e0 con 0x7f22e406d7f0 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1400640 1 -- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e4155a20 msgr2=0x7f22e40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1400640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e4155a20 0x7f22e40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1400640 1 -- 172.21.15.46:0/267076552 >> v1:172.21.15.46:6789/0 conn(0x7f22e406d7f0 legacy=0x7f22e40ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.918+0000 7f22e1400640 1 -- 172.21.15.46:0/267076552 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e406e8c0 con 0x7f22e4155df0 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.919+0000 7f22e1400640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e40ad9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009850 tx=0x7f22d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3821feea1f462a84 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e0a00640 1 -- 172.21.15.46:0/267076552 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d002ad90 con 0x7f22e4155df0 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e0a00640 1 -- 172.21.15.46:0/267076552 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0032440 con 0x7f22e4155df0 2024-08-17T02:27:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e0a00640 1 -- 172.21.15.46:0/267076552 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0032820 con 0x7f22e4155df0 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 -- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 msgr2=0x7f22e40ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e40ad9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009850 tx=0x7f22d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 -- 172.21.15.46:0/267076552 shutdown_connections 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e40ad9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 --2- 172.21.15.46:0/267076552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e4155a20 0x7f22e40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 -- 172.21.15.46:0/267076552 >> 172.21.15.46:0/267076552 conn(0x7f22e40cb9b0 msgr2=0x7f22e40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 -- 172.21.15.46:0/267076552 shutdown_connections 2024-08-17T02:27:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.920+0000 7f22e8c00640 1 -- 172.21.15.46:0/267076552 wait complete. 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.922+0000 7f22e8c00640 1 Processor -- start 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.922+0000 7f22e8c00640 1 -- start start 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e406d7f0 0x7f22e4151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40c15b0 con 0x7f22e4155a20 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40c09a0 con 0x7f22e4155df0 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40c0c80 con 0x7f22e406d7f0 2024-08-17T02:27:50.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60662/0 (socket says 172.21.15.46:60662) 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 -- 172.21.15.46:0/2795657271 learned_addr learned my addr 172.21.15.46:0/2795657271 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1e00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e406d7f0 0x7f22e4151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e2800640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 -- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e406d7f0 msgr2=0x7f22e4151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e406d7f0 0x7f22e4151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 -- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 msgr2=0x7f22e415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e1400640 1 -- 172.21.15.46:0/2795657271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0009390 con 0x7f22e4155a20 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.923+0000 7f22e2800640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22e1400640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22d0035040 tx=0x7f22d0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0031ca0 con 0x7f22e4155a20 2024-08-17T02:27:50.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0031e00 con 0x7f22e4155a20 2024-08-17T02:27:50.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e40c0f60 con 0x7f22e4155a20 2024-08-17T02:27:50.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d003e6a0 con 0x7f22e4155a20 2024-08-17T02:27:50.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.924+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41520f0 con 0x7f22e4155a20 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.925+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e40c0dc0 con 0x7f22e4155a20 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.926+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f22d003c400 con 0x7f22e4155a20 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.927+0000 7f22d9600640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 0x7f22c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.927+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22d00a2c50 con 0x7f22e4155a20 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.927+0000 7f22e1e00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 0x7f22c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.928+0000 7f22e1e00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 0x7f22c4067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009360 tx=0x7f22d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:50.930+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22e40c0dc0 con 0x7f22e4155a20 2024-08-17T02:27:51.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.150+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e40c0dc0 con 0x7f22e4155a20 2024-08-17T02:27:51.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.150+0000 7f22d9600640 1 -- 172.21.15.46:0/2795657271 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f22e40c0dc0 con 0x7f22e4155a20 2024-08-17T02:27:51.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:51.151 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.152+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 msgr2=0x7f22c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.152+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 0x7f22c4067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009360 tx=0x7f22d4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.152+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 msgr2=0x7f22e40c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.152+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22d0035040 tx=0x7f22d0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.152+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 shutdown_connections 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22e4155df0 0x7f22e415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22e4155a20 0x7f22e40c1a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f22c4065150 0x7f22c4067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 --2- 172.21.15.46:0/2795657271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22e406d7f0 0x7f22e4151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 >> 172.21.15.46:0/2795657271 conn(0x7f22e40cb9b0 msgr2=0x7f22e4068b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 shutdown_connections 2024-08-17T02:27:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.153+0000 7f22e8c00640 1 -- 172.21.15.46:0/2795657271 wait complete. 2024-08-17T02:27:51.168 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.320+0000 7f95c6a00640 1 Processor -- start 2024-08-17T02:27:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.321+0000 7f95c6a00640 1 -- start start 2024-08-17T02:27:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95c00aed50 0x7f95c00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00cc890 con 0x7f95c00c5c40 2024-08-17T02:27:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00ceb20 con 0x7f95c00ce6d0 2024-08-17T02:27:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c00cb4c0 con 0x7f95c00aed50 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c5600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95c00aed50 0x7f95c00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f95c00c5c40 0x7f95c01627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43354/0 (socket says 172.21.15.46:43354) 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c5600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95c00aed50 0x7f95c00ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60678/0 (socket says 172.21.15.46:60678) 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c6000640 1 -- 172.21.15.46:0/2566104439 learned_addr learned my addr 172.21.15.46:0/2566104439 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.322+0000 7f95c5600640 1 -- 172.21.15.46:0/2566104439 >> v1:172.21.15.162:6789/0 conn(0x7f95c00ce6d0 legacy=0x7f95c00ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.323+0000 7f95c5600640 1 -- 172.21.15.46:0/2566104439 >> v1:172.21.15.46:6789/0 conn(0x7f95c00c5c40 legacy=0x7f95c01627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.323+0000 7f95bfe00640 1 -- 172.21.15.46:0/2566104439 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710193164 0 0) 0x7f95c00cc890 con 0x7f95c00c5c40 2024-08-17T02:27:51.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.323+0000 7f95c5600640 1 -- 172.21.15.46:0/2566104439 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cb7a0 con 0x7f95c00aed50 2024-08-17T02:27:51.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c5600640 1 --2- 172.21.15.46:0/2566104439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00aed50 0x7f95c00ce190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009850 tx=0x7f95b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ded7b04ac997ecc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95bfe00640 1 -- 172.21.15.46:0/2566104439 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b402ae20 con 0x7f95c00aed50 2024-08-17T02:27:51.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95bfe00640 1 -- 172.21.15.46:0/2566104439 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4032440 con 0x7f95c00aed50 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95bfe00640 1 -- 172.21.15.46:0/2566104439 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40327e0 con 0x7f95c00aed50 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c6a00640 1 -- 172.21.15.46:0/2566104439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00aed50 msgr2=0x7f95c00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2566104439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00aed50 0x7f95c00ce190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009850 tx=0x7f95b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c6a00640 1 -- 172.21.15.46:0/2566104439 shutdown_connections 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2566104439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00aed50 0x7f95c00ce190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.324+0000 7f95c6a00640 1 -- 172.21.15.46:0/2566104439 >> 172.21.15.46:0/2566104439 conn(0x7f95c0098e30 msgr2=0x7f95c006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.325+0000 7f95c6a00640 1 -- 172.21.15.46:0/2566104439 shutdown_connections 2024-08-17T02:27:51.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.325+0000 7f95c6a00640 1 -- 172.21.15.46:0/2566104439 wait complete. 2024-08-17T02:27:51.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.326+0000 7f95c6a00640 1 Processor -- start 2024-08-17T02:27:51.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.326+0000 7f95c6a00640 1 -- start start 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00aed50 0x7f95c01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00c5c40 0x7f95c0158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b1130 con 0x7f95c00ce6d0 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b1410 con 0x7f95c00c5c40 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00b16f0 con 0x7f95c00aed50 2024-08-17T02:27:51.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60694/0 (socket says 172.21.15.46:60694) 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c6000640 1 -- 172.21.15.46:0/2746272105 learned_addr learned my addr 172.21.15.46:0/2746272105 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c4c00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00c5c40 0x7f95c0158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.327+0000 7f95c5600640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00aed50 0x7f95c01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 -- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00aed50 msgr2=0x7f95c01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00aed50 0x7f95c01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 -- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00c5c40 msgr2=0x7f95c0158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00c5c40 0x7f95c0158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 -- 172.21.15.46:0/2746272105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b4009390 con 0x7f95c00ce6d0 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6000640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95b800cbf0 tx=0x7f95b80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800ce10 con 0x7f95c00ce6d0 2024-08-17T02:27:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800a850 con 0x7f95c00ce6d0 2024-08-17T02:27:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800ac90 con 0x7f95c00ce6d0 2024-08-17T02:27:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c00b19d0 con 0x7f95c00ce6d0 2024-08-17T02:27:51.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.328+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c00b0400 con 0x7f95c00ce6d0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.329+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0071050 con 0x7f95c00ce6d0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.330+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95b8007300 con 0x7f95c00ce6d0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.331+0000 7f95bcc00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 0x7f95a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.331+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95b8082490 con 0x7f95c00ce6d0 2024-08-17T02:27:51.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.331+0000 7f95c5600640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 0x7f95a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.332+0000 7f95c5600640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 0x7f95a0067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95b4034000 tx=0x7f95b4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.335+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95b80505e0 con 0x7f95c00ce6d0 2024-08-17T02:27:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.523+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c00cffc0 con 0x7f95c00ce6d0 2024-08-17T02:27:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.524+0000 7f95bcc00640 1 -- 172.21.15.46:0/2746272105 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f95b800b0d0 con 0x7f95c00ce6d0 2024-08-17T02:27:51.524 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:51.524 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.526+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 msgr2=0x7f95a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.526+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 0x7f95a0067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f95b4034000 tx=0x7f95b4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.526+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 msgr2=0x7f95c01587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.526+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f95b800cbf0 tx=0x7f95b80019b0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.526+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 shutdown_connections 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95c00ce6d0 0x7f95c01587b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00c5c40 0x7f95c0158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95a0065150 0x7f95a0067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 --2- 172.21.15.46:0/2746272105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00aed50 0x7f95c01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 >> 172.21.15.46:0/2746272105 conn(0x7f95c0098e30 msgr2=0x7f95c0068240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 shutdown_connections 2024-08-17T02:27:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.527+0000 7f95c6a00640 1 -- 172.21.15.46:0/2746272105 wait complete. 2024-08-17T02:27:51.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:27:51.542 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.696+0000 7f5b06800640 1 Processor -- start 2024-08-17T02:27:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.696+0000 7f5b06800640 1 -- start start 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.697+0000 7f5b06800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b000ac250 0x7f5b0015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.697+0000 7f5b06800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5b001584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.697+0000 7f5b06800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0015d970 con 0x7f5b0006ed50 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.697+0000 7f5b06800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0015a360 con 0x7f5b000ac250 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.697+0000 7f5b06800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015d0d0 con 0x7f5b00159f00 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5aff400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5b0006ed50 0x7f5b000abb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43364/0 (socket says 172.21.15.46:43364) 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5aff400640 1 -- 172.21.15.46:0/1954191318 learned_addr learned my addr 172.21.15.46:0/1954191318 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016839497 0 0) 0x7f5af0001110 con 0x7f5b0006ed50 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5affe00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5b001584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5af7e00640 1 --2- 172.21.15.46:0/1954191318 >> v2:172.21.15.162:3300/0 conn(0x7f5b000ac250 0x7f5b0015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae40034e0 con 0x7f5b0006ed50 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2766202839 0 0) 0x7f5ae40034e0 con 0x7f5b0006ed50 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 msgr2=0x7f5b001584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5b001584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 >> v2:172.21.15.162:3300/0 conn(0x7f5b000ac250 msgr2=0x7f5b0015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 --2- 172.21.15.46:0/1954191318 >> v2:172.21.15.162:3300/0 conn(0x7f5b000ac250 0x7f5b0015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0015d3b0 con 0x7f5b0006ed50 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f5af0001600 con 0x7f5b0006ed50 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.698+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 >> v1:172.21.15.46:6789/0 conn(0x7f5b0006ed50 legacy=0x7f5b000abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae40039d0 0x7f5ae4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ae4004780 0x7f5ae4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5ae4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015a360 con 0x7f5ae4004780 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015d0d0 con 0x7f5ae40039d0 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae400b9d0 con 0x7f5b00159f00 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ae4004780 0x7f5ae4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5aff400640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae40039d0 0x7f5ae4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5affe00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5ae4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 -- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 msgr2=0x7f5ae4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b00159f00 0x7f5ae4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 -- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae40039d0 msgr2=0x7f5ae4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae40039d0 0x7f5ae4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.699+0000 7f5af7e00640 1 -- 172.21.15.46:0/1954191318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40034e0 con 0x7f5ae4004780 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.700+0000 7f5af7e00640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ae4004780 0x7f5ae4004bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009b70 tx=0x7f5ae80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164113ffbc0c207b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.700+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8031400 con 0x7f5ae4004780 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.700+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae802d050 con 0x7f5ae4004780 2024-08-17T02:27:51.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.700+0000 7f5afea00640 1 -- 172.21.15.46:0/1954191318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8031790 con 0x7f5ae4004780 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 -- 172.21.15.46:0/1954191318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ae4004780 msgr2=0x7f5ae4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 --2- 172.21.15.46:0/1954191318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ae4004780 0x7f5ae4004bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009b70 tx=0x7f5ae80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5affe00640 1 -- 172.21.15.46:0/1954191318 reap_dead start 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 -- 172.21.15.46:0/1954191318 shutdown_connections 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 -- 172.21.15.46:0/1954191318 >> 172.21.15.46:0/1954191318 conn(0x7f5b000ccc70 msgr2=0x7f5b000a8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 -- 172.21.15.46:0/1954191318 shutdown_connections 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.701+0000 7f5b06800640 1 -- 172.21.15.46:0/1954191318 wait complete. 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.703+0000 7f5b06800640 1 Processor -- start 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.703+0000 7f5b06800640 1 -- start start 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.703+0000 7f5b06800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae4004780 0x7f5b00097ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.703+0000 7f5b06800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b001583f0 0x7f5b0014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5b06800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5b06800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015c0a0 con 0x7f5b0015b6c0 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5b06800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00099290 con 0x7f5ae4004780 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5b06800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00098400 con 0x7f5b001583f0 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60720/0 (socket says 172.21.15.46:60720) 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 -- 172.21.15.46:0/287863318 learned_addr learned my addr 172.21.15.46:0/287863318 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5aff400640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae4004780 0x7f5b00097ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5af7e00640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b001583f0 0x7f5b0014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 -- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b001583f0 msgr2=0x7f5b0014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b001583f0 0x7f5b0014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 -- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae4004780 msgr2=0x7f5b00097ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae4004780 0x7f5b00097ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 -- 172.21.15.46:0/287863318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00098680 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.704+0000 7f5affe00640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5af80094d0 tx=0x7f5af800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.705+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800e040 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.705+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800f040 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.705+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8015940 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.705+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b00098960 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.705+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00098f20 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.706+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b00099440 con 0x7f5b0015b6c0 2024-08-17T02:27:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.707+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5af8015d30 con 0x7f5b0015b6c0 2024-08-17T02:27:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.707+0000 7f5af6a00640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 0x7f5adc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.707+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5af8082640 con 0x7f5b0015b6c0 2024-08-17T02:27:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.708+0000 7f5aff400640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 0x7f5adc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.709+0000 7f5aff400640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 0x7f5adc067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b000c5bf0 tx=0x7f5af00079f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.711+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b00099440 con 0x7f5b0015b6c0 2024-08-17T02:27:51.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.892+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b00099440 con 0x7f5b0015b6c0 2024-08-17T02:27:51.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.893+0000 7f5af6a00640 1 -- 172.21.15.46:0/287863318 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b00099440 con 0x7f5b0015b6c0 2024-08-17T02:27:51.893 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 msgr2=0x7f5adc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 0x7f5adc067630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5b000c5bf0 tx=0x7f5af00079f0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 msgr2=0x7f5b0015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5af80094d0 tx=0x7f5af800b040 comp rx=0 tx=0).stop 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 shutdown_connections 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0015b6c0 0x7f5b0015bb60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5adc065180 0x7f5adc067630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b001583f0 0x7f5b0014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 --2- 172.21.15.46:0/287863318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ae4004780 0x7f5b00097ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 >> 172.21.15.46:0/287863318 conn(0x7f5b000ccc70 msgr2=0x7f5b0015a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 shutdown_connections 2024-08-17T02:27:51.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:51.895+0000 7f5b06800640 1 -- 172.21.15.46:0/287863318 wait complete. 2024-08-17T02:27:51.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:27:52.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.065+0000 7f456bc00640 1 Processor -- start 2024-08-17T02:27:52.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.065+0000 7f456bc00640 1 -- start start 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f456bc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f45640b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f456bc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640afbb0 con 0x7f456415c2f0 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f456bc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45640afe90 con 0x7f45640b0d50 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f456bc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b1e10 con 0x7f45640d0890 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f4569200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f456415c2f0 0x7f45640af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43374/0 (socket says 172.21.15.46:43374) 2024-08-17T02:27:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.066+0000 7f4569200640 1 -- 172.21.15.46:0/1897712822 learned_addr learned my addr 172.21.15.46:0/1897712822 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856299148 0 0) 0x7f45640afbb0 con 0x7f456415c2f0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c0034e0 con 0x7f456415c2f0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563e00640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f45640b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665652634 0 0) 0x7f454c0034e0 con 0x7f456415c2f0 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 msgr2=0x7f45640b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f45640b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 >> v1:172.21.15.162:6789/0 conn(0x7f45640b0d50 legacy=0x7f45640b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640b0170 con 0x7f456415c2f0 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f4558001470 con 0x7f456415c2f0 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 >> v1:172.21.15.46:6789/0 conn(0x7f456415c2f0 legacy=0x7f45640af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f454c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f454c004780 0x7f454c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f454c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45640b1e10 con 0x7f454c003a00 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c00ba80 con 0x7f454c004780 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.067+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c00bc10 con 0x7f45640d0890 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f454c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569c00640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f454c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4563e00640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f454c004780 0x7f454c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 -- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 msgr2=0x7f454c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640d0890 0x7f454c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 -- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f454c004780 msgr2=0x7f454c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f454c004780 0x7f454c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.068+0000 7f4569200640 1 -- 172.21.15.46:0/1897712822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0034e0 con 0x7f454c003a00 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.069+0000 7f4569200640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f454c003dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4558005040 tx=0x7f4558008b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e10047042fc315 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.069+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558008150 con 0x7f454c003a00 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.069+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45580082d0 con 0x7f454c003a00 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.069+0000 7f4563400640 1 -- 172.21.15.46:0/1897712822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558008480 con 0x7f454c003a00 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 -- 172.21.15.46:0/1897712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 msgr2=0x7f454c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 --2- 172.21.15.46:0/1897712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f454c003dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4558005040 tx=0x7f4558008b40 comp rx=0 tx=0).stop 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f4569c00640 1 -- 172.21.15.46:0/1897712822 reap_dead start 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 -- 172.21.15.46:0/1897712822 shutdown_connections 2024-08-17T02:27:52.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 -- 172.21.15.46:0/1897712822 >> 172.21.15.46:0/1897712822 conn(0x7f45640cfdb0 msgr2=0x7f45640d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 -- 172.21.15.46:0/1897712822 shutdown_connections 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.070+0000 7f456bc00640 1 -- 172.21.15.46:0/1897712822 wait complete. 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.071+0000 7f456bc00640 1 Processor -- start 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.071+0000 7f456bc00640 1 -- start start 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640cd550 0x7f456415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45640cd9c0 0x7f456415a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456409d850 con 0x7f454c003a00 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456409cc80 con 0x7f45640cd9c0 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f456bc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456414bd80 con 0x7f45640cd550 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.072+0000 7f4569200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60736/0 (socket says 172.21.15.46:60736) 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 -- 172.21.15.46:0/1695964685 learned_addr learned my addr 172.21.15.46:0/1695964685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569c00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45640cd9c0 0x7f456415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4563e00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640cd550 0x7f456415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 -- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640cd550 msgr2=0x7f456415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640cd550 0x7f456415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 -- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45640cd9c0 msgr2=0x7f456415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45640cd9c0 0x7f456415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 -- 172.21.15.46:0/1695964685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456409cf20 con 0x7f454c003a00 2024-08-17T02:27:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.073+0000 7f4569200640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4558001ed0 tx=0x7f4558030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.074+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558005870 con 0x7f454c003a00 2024-08-17T02:27:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.074+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45580059d0 con 0x7f454c003a00 2024-08-17T02:27:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.074+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558005d90 con 0x7f454c003a00 2024-08-17T02:27:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.074+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456409d200 con 0x7f454c003a00 2024-08-17T02:27:52.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.074+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456409a5b0 con 0x7f454c003a00 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.075+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456409d9c0 con 0x7f454c003a00 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.076+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f455802b980 con 0x7f454c003a00 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.076+0000 7f4557e00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 0x7f4544067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.077+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45580a1ef0 con 0x7f454c003a00 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.077+0000 7f4563e00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 0x7f4544067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.078+0000 7f4563e00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 0x7f4544067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f456415c000 tx=0x7f45500090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.080+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4558070060 con 0x7f454c003a00 2024-08-17T02:27:52.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.262+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f456409a7a0 con 0x7f454c003a00 2024-08-17T02:27:52.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.263+0000 7f4557e00640 1 -- 172.21.15.46:0/1695964685 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f456409a7a0 con 0x7f454c003a00 2024-08-17T02:27:52.263 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 msgr2=0x7f4544067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 0x7f4544067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f456415c000 tx=0x7f45500090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 msgr2=0x7f456414b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4558001ed0 tx=0x7f4558030000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 shutdown_connections 2024-08-17T02:27:52.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45640cd9c0 0x7f456415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4544065150 0x7f4544067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45640cd550 0x7f456415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 --2- 172.21.15.46:0/1695964685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c003a00 0x7f456414b840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 >> 172.21.15.46:0/1695964685 conn(0x7f45640cfdb0 msgr2=0x7f45640d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.265+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 shutdown_connections 2024-08-17T02:27:52.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.266+0000 7f456bc00640 1 -- 172.21.15.46:0/1695964685 wait complete. 2024-08-17T02:27:52.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.434+0000 7f66f2400640 1 Processor -- start 2024-08-17T02:27:52.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.434+0000 7f66f2400640 1 -- start start 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.435+0000 7f66f2400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66ec0adcf0 0x7f66ec0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.435+0000 7f66f2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 0x7f66ec0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.435+0000 7f66f2400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0ab130 con 0x7f66ec156c50 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.435+0000 7f66f2400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec0ae5a0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.435+0000 7f66f2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0ae2c0 con 0x7f66ec0abb00 2024-08-17T02:27:52.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66eb400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f66ec156c50 0x7f66ec0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43376/0 (socket says 172.21.15.46:43376) 2024-08-17T02:27:52.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66eb400640 1 -- 172.21.15.46:0/1800964240 learned_addr learned my addr 172.21.15.46:0/1800964240 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66e3e00640 1 --2- 172.21.15.46:0/1800964240 >> v2:172.21.15.162:3300/0 conn(0x7f66ec0adcf0 0x7f66ec0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66ebe00640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 0x7f66ec0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66eaa00640 1 -- 172.21.15.46:0/1800964240 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029132612 0 0) 0x7f66ec0ab130 con 0x7f66ec156c50 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66eaa00640 1 -- 172.21.15.46:0/1800964240 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d00034e0 con 0x7f66ec156c50 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66e3e00640 1 -- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 msgr2=0x7f66ec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66e3e00640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 0x7f66ec0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66e3e00640 1 -- 172.21.15.46:0/1800964240 >> v1:172.21.15.46:6789/0 conn(0x7f66ec156c50 legacy=0x7f66ec0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66e3e00640 1 -- 172.21.15.46:0/1800964240 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0aaae0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.436+0000 7f66ebe00640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 0x7f66ec0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:52.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66e3e00640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0adcf0 0x7f66ec0ab5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2998b0a528ba6fd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66eaa00640 1 -- 172.21.15.46:0/1800964240 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d402ac80 con 0x7f66ec0adcf0 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66eaa00640 1 -- 172.21.15.46:0/1800964240 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d402ade0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66eaa00640 1 -- 172.21.15.46:0/1800964240 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4032650 con 0x7f66ec0adcf0 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66f2400640 1 -- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0adcf0 msgr2=0x7f66ec0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.438+0000 7f66f2400640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0adcf0 0x7f66ec0ab5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 -- 172.21.15.46:0/1800964240 shutdown_connections 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec0abb00 0x7f66ec0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 --2- 172.21.15.46:0/1800964240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0adcf0 0x7f66ec0ab5c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 -- 172.21.15.46:0/1800964240 >> 172.21.15.46:0/1800964240 conn(0x7f66ec067750 msgr2=0x7f66ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 -- 172.21.15.46:0/1800964240 shutdown_connections 2024-08-17T02:27:52.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.439+0000 7f66f2400640 1 -- 172.21.15.46:0/1800964240 wait complete. 2024-08-17T02:27:52.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.440+0000 7f66f2400640 1 Processor -- start 2024-08-17T02:27:52.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.440+0000 7f66f2400640 1 -- start start 2024-08-17T02:27:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0abb00 0x7f66ec1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec156c50 0x7f66ec0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06e250 con 0x7f66ec0adcf0 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06d710 con 0x7f66ec0abb00 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66f2400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec06d9b0 con 0x7f66ec156c50 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60750/0 (socket says 172.21.15.46:60750) 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66e3e00640 1 -- 172.21.15.46:0/2729193864 learned_addr learned my addr 172.21.15.46:0/2729193864 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66eb400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0abb00 0x7f66ec1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.441+0000 7f66ebe00640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec156c50 0x7f66ec0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 -- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec156c50 msgr2=0x7f66ec0a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec156c50 0x7f66ec0a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 -- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0abb00 msgr2=0x7f66ec1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0abb00 0x7f66ec1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 -- 172.21.15.46:0/2729193864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e4009a20 con 0x7f66ec0adcf0 2024-08-17T02:27:52.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e3e00640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d403e660 con 0x7f66ec0adcf0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d403e7c0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d403eb60 con 0x7f66ec0adcf0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.442+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d4009390 con 0x7f66ec0adcf0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.443+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec06df70 con 0x7f66ec0adcf0 2024-08-17T02:27:52.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.443+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec071050 con 0x7f66ec0adcf0 2024-08-17T02:27:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.444+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66d403c400 con 0x7f66ec0adcf0 2024-08-17T02:27:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.445+0000 7f66e2a00640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.445+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66d40a21e0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.445+0000 7f66eb400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.446+0000 7f66eb400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 0x7f66c8067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66ec156690 tx=0x7f66dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.449+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66d40702b0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.629+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66ec0ca9d0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.629+0000 7f66e2a00640 1 -- 172.21.15.46:0/2729193864 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66d40738d0 con 0x7f66ec0adcf0 2024-08-17T02:27:52.630 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.631+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 msgr2=0x7f66c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.631+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 0x7f66c8067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f66ec156690 tx=0x7f66dc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 msgr2=0x7f66ec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009850 tx=0x7f66d4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 shutdown_connections 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ec156c50 0x7f66ec0a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66ec0adcf0 0x7f66ec06d1d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 --2- 172.21.15.46:0/2729193864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ec0abb00 0x7f66ec1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 >> 172.21.15.46:0/2729193864 conn(0x7f66ec067750 msgr2=0x7f66ec0cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 shutdown_connections 2024-08-17T02:27:52.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.632+0000 7f66f2400640 1 -- 172.21.15.46:0/2729193864 wait complete. 2024-08-17T02:27:52.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:52.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.797+0000 7f48fac00640 1 Processor -- start 2024-08-17T02:27:52.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.797+0000 7f48fac00640 1 -- start start 2024-08-17T02:27:52.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.798+0000 7f48fac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48f4155180 0x7f48f40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.798+0000 7f48fac00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40afc10 con 0x7f48f406e080 2024-08-17T02:27:52.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.798+0000 7f48fac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f40af000 con 0x7f48f4155550 2024-08-17T02:27:52.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.798+0000 7f48fac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f40af2e0 con 0x7f48f4155180 2024-08-17T02:27:52.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f8c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f48f406e080 0x7f48f406e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43384/0 (socket says 172.21.15.46:43384) 2024-08-17T02:27:52.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f8c00640 1 -- 172.21.15.46:0/3409155407 learned_addr learned my addr 172.21.15.46:0/3409155407 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:52.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3409155407 >> v2:172.21.15.162:3300/0 conn(0x7f48f4155180 0x7f48f40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622431749 0 0) 0x7f48f40afc10 con 0x7f48f406e080 2024-08-17T02:27:52.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d80045f0 con 0x7f48f406e080 2024-08-17T02:27:52.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379799838 0 0) 0x7f48d80045f0 con 0x7f48f406e080 2024-08-17T02:27:52.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 >> v2:172.21.15.162:3300/0 conn(0x7f48f4155180 msgr2=0x7f48f40aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 --2- 172.21.15.46:0/3409155407 >> v2:172.21.15.162:3300/0 conn(0x7f48f4155180 0x7f48f40aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 >> v1:172.21.15.162:6789/0 conn(0x7f48f4155550 legacy=0x7f48f40ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40af5c0 con 0x7f48f406e080 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f48ec001810 con 0x7f48f406e080 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.799+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 >> v1:172.21.15.46:6789/0 conn(0x7f48f406e080 legacy=0x7f48f406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 0x7f48d8004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48d8005890 0x7f48d8005d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8006240 0x7f48d800cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f40af2e0 con 0x7f48d8004ae0 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d800d0d0 con 0x7f48d8005890 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d8003480 con 0x7f48d8006240 2024-08-17T02:27:52.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 0x7f48d8004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f8c00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8006240 0x7f48d800cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48ebe00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48d8005890 0x7f48d8005d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 -- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8006240 msgr2=0x7f48d800cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8006240 0x7f48d800cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 -- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48d8005890 msgr2=0x7f48d8005d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48d8005890 0x7f48d8005d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f3e00640 1 -- 172.21.15.46:0/3409155407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80045f0 con 0x7f48d8004ae0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f8c00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8006240 0x7f48d800cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.800+0000 7f48f8c00640 1 -- 172.21.15.46:0/3409155407 reap_dead start 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.801+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 0x7f48d8004eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b70 tx=0x7f48e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da780dd095c9205a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.801+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4031400 con 0x7f48d8004ae0 2024-08-17T02:27:52.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.801+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e402d050 con 0x7f48d8004ae0 2024-08-17T02:27:52.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.801+0000 7f48f3400640 1 -- 172.21.15.46:0/3409155407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4031790 con 0x7f48d8004ae0 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 -- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 msgr2=0x7f48d8004eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 0x7f48d8004eb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b70 tx=0x7f48e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 -- 172.21.15.46:0/3409155407 shutdown_connections 2024-08-17T02:27:52.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 --2- 172.21.15.46:0/3409155407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48d8004ae0 0x7f48d8004eb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 -- 172.21.15.46:0/3409155407 >> 172.21.15.46:0/3409155407 conn(0x7f48f40cb9b0 msgr2=0x7f48f40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 -- 172.21.15.46:0/3409155407 shutdown_connections 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.802+0000 7f48fac00640 1 -- 172.21.15.46:0/3409155407 wait complete. 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.803+0000 7f48fac00640 1 Processor -- start 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 -- start start 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8004ae0 0x7f48f4157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 0x7f48f413ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4158160 con 0x7f48f414da80 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4156e60 con 0x7f48f4151fd0 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.804+0000 7f48fac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4157140 con 0x7f48d8004ae0 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60768/0 (socket says 172.21.15.46:60768) 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 -- 172.21.15.46:0/3547451369 learned_addr learned my addr 172.21.15.46:0/3547451369 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8004ae0 0x7f48f4157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48f8c00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 0x7f48f413ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 -- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8004ae0 msgr2=0x7f48f4157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8004ae0 0x7f48f4157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 -- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 msgr2=0x7f48f413ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 0x7f48f413ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 -- 172.21.15.46:0/3547451369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f4157420 con 0x7f48f414da80 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48f8c00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 0x7f48f413ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.805+0000 7f48ebe00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00e890 tx=0x7f48dc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.806+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00ee20 con 0x7f48f414da80 2024-08-17T02:27:52.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.806+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00c8d0 con 0x7f48f414da80 2024-08-17T02:27:52.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.806+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00cc90 con 0x7f48f414da80 2024-08-17T02:27:52.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.806+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f4157700 con 0x7f48f414da80 2024-08-17T02:27:52.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.806+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f4156b10 con 0x7f48f414da80 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.807+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f41578f0 con 0x7f48f414da80 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.808+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f48dc01d460 con 0x7f48f414da80 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.808+0000 7f48eb400640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 0x7f48d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.809+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48dc082940 con 0x7f48f414da80 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.809+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 0x7f48d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.810+0000 7f48f3e00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 0x7f48d0067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b70 tx=0x7f48e4035000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:52.812+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48dc050960 con 0x7f48f414da80 2024-08-17T02:27:53.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.032+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48f4064db0 con 0x7f48f414da80 2024-08-17T02:27:53.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.032+0000 7f48eb400640 1 -- 172.21.15.46:0/3547451369 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f48dc053f80 con 0x7f48f414da80 2024-08-17T02:27:53.032 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:53.032 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:53.033 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:27:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 msgr2=0x7f48d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 0x7f48d0067630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009b70 tx=0x7f48e4035000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 msgr2=0x7f48f414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00e890 tx=0x7f48dc009040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 shutdown_connections 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f4151fd0 0x7f48f413ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48f414da80 0x7f48f414e8c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f48d0065180 0x7f48d0067630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 --2- 172.21.15.46:0/3547451369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48d8004ae0 0x7f48f4157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 >> 172.21.15.46:0/3547451369 conn(0x7f48f40cb9b0 msgr2=0x7f48f40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.034+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 shutdown_connections 2024-08-17T02:27:53.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.035+0000 7f48fac00640 1 -- 172.21.15.46:0/3547451369 wait complete. 2024-08-17T02:27:53.049 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:53.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.201+0000 7ff110c00640 1 Processor -- start 2024-08-17T02:27:53.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.201+0000 7ff110c00640 1 -- start start 2024-08-17T02:27:53.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff110c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff10c1559a0 0x7ff10c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff110c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff110c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0ad9e0 con 0x7ff10c0ad5a0 2024-08-17T02:27:53.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff110c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0b0860 con 0x7ff10c1559a0 2024-08-17T02:27:53.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff110c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0aa8d0 con 0x7ff10c0afb50 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff10a800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff10c0ad5a0 0x7ff10c0ab090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:46830/0 (socket says 172.21.15.46:46830) 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff109e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff10c1559a0 0x7ff10c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff103e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.202+0000 7ff10a800640 1 -- 172.21.15.46:0/2550321105 learned_addr learned my addr 172.21.15.46:0/2550321105 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109400640 1 -- 172.21.15.46:0/2550321105 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206923959 0 0) 0x7ff10c0ad9e0 con 0x7ff10c0ad5a0 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109400640 1 -- 172.21.15.46:0/2550321105 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f00034e0 con 0x7ff10c0ad5a0 2024-08-17T02:27:53.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109e00640 1 -- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 msgr2=0x7ff10c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109e00640 1 --2- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109e00640 1 -- 172.21.15.46:0/2550321105 >> v1:172.21.15.162:6789/0 conn(0x7ff10c0ad5a0 legacy=0x7ff10c0ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.203+0000 7ff109e00640 1 -- 172.21.15.46:0/2550321105 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0b02a0 con 0x7ff10c1559a0 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.204+0000 7ff109e00640 1 --2- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c1559a0 0x7ff10c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009850 tx=0x7ff0fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f990fa4353fcb424 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.204+0000 7ff109400640 1 -- 172.21.15.46:0/2550321105 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc02ad80 con 0x7ff10c1559a0 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.204+0000 7ff109400640 1 -- 172.21.15.46:0/2550321105 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc032440 con 0x7ff10c1559a0 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.204+0000 7ff109400640 1 -- 172.21.15.46:0/2550321105 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc032820 con 0x7ff10c1559a0 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 -- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c1559a0 msgr2=0x7ff10c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 --2- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c1559a0 0x7ff10c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009850 tx=0x7ff0fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 -- 172.21.15.46:0/2550321105 shutdown_connections 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 --2- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 --2- 172.21.15.46:0/2550321105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c1559a0 0x7ff10c06e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 -- 172.21.15.46:0/2550321105 >> 172.21.15.46:0/2550321105 conn(0x7ff10c066cd0 msgr2=0x7ff10c0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 -- 172.21.15.46:0/2550321105 shutdown_connections 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.205+0000 7ff110c00640 1 -- 172.21.15.46:0/2550321105 wait complete. 2024-08-17T02:27:53.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.206+0000 7ff110c00640 1 Processor -- start 2024-08-17T02:27:53.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.206+0000 7ff110c00640 1 -- start start 2024-08-17T02:27:53.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c0ad5a0 0x7ff10c16d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c15c420 con 0x7ff10c1559a0 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c148bd0 con 0x7ff10c0ad5a0 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff110c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c15bf90 con 0x7ff10c0afb50 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff10a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.207+0000 7ff10a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60772/0 (socket says 172.21.15.46:60772) 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 -- 172.21.15.46:0/1201015176 learned_addr learned my addr 172.21.15.46:0/1201015176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff103e00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff109e00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c0ad5a0 0x7ff10c16d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 -- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 msgr2=0x7ff10c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 -- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c0ad5a0 msgr2=0x7ff10c16d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c0ad5a0 0x7ff10c16d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 -- 172.21.15.46:0/1201015176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc009390 con 0x7ff10c1559a0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.208+0000 7ff10a800640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff10400cbc0 tx=0x7ff104001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.209+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400a640 con 0x7ff10c1559a0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.209+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400a7a0 con 0x7ff10c1559a0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.209+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400ab80 con 0x7ff10c1559a0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.209+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c15bc90 con 0x7ff10c1559a0 2024-08-17T02:27:53.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.209+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0c7c70 con 0x7ff10c1559a0 2024-08-17T02:27:53.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.210+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c15c140 con 0x7ff10c1559a0 2024-08-17T02:27:53.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.211+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff104007300 con 0x7ff10c1559a0 2024-08-17T02:27:53.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.212+0000 7ff101600640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 0x7ff0e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.212+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff104082650 con 0x7ff10c1559a0 2024-08-17T02:27:53.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.212+0000 7ff109e00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 0x7ff0e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.213+0000 7ff109e00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 0x7ff0e8067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc034000 tx=0x7ff0fc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.216+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff10c15c140 con 0x7ff10c1559a0 2024-08-17T02:27:53.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.399+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff10c15c100 con 0x7ff10c1559a0 2024-08-17T02:27:53.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.400+0000 7ff101600640 1 -- 172.21.15.46:0/1201015176 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff1040507a0 con 0x7ff10c1559a0 2024-08-17T02:27:53.400 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:53.400 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 msgr2=0x7ff0e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 0x7ff0e8067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc034000 tx=0x7ff0fc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 msgr2=0x7ff10c0a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff10400cbc0 tx=0x7ff104001a00 comp rx=0 tx=0).stop 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 shutdown_connections 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff10c1559a0 0x7ff10c0a9e20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff0e8065150 0x7ff0e8067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff10c0afb50 0x7ff10c0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 --2- 172.21.15.46:0/1201015176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff10c0ad5a0 0x7ff10c16d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.402+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 >> 172.21.15.46:0/1201015176 conn(0x7ff10c066cd0 msgr2=0x7ff10c068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.403+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 shutdown_connections 2024-08-17T02:27:53.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.403+0000 7ff110c00640 1 -- 172.21.15.46:0/1201015176 wait complete. 2024-08-17T02:27:53.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:53.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.570+0000 7f6f51c00640 1 Processor -- start 2024-08-17T02:27:53.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.570+0000 7f6f51c00640 1 -- start start 2024-08-17T02:27:53.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f51c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6f4c155a20 0x7f6f4c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f51c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f4c155df0 0x7f6f4c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f51c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c156670 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f51c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c0b0350 con 0x7f6f4c155a20 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f51c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c06e5e0 con 0x7f6f4c155df0 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f4aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6f4c155a20 0x7f6f4c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f4aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6f4c155a20 0x7f6f4c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60780/0 (socket says 172.21.15.46:60780) 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.571+0000 7f6f4aa00640 1 -- 172.21.15.46:0/885249483 learned_addr learned my addr 172.21.15.46:0/885249483 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.572+0000 7f6f4a000640 1 --2- 172.21.15.46:0/885249483 >> v2:172.21.15.162:3300/0 conn(0x7f6f4c155df0 0x7f6f4c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.572+0000 7f6f4aa00640 1 -- 172.21.15.46:0/885249483 >> v2:172.21.15.162:3300/0 conn(0x7f6f4c155df0 msgr2=0x7f6f4c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.572+0000 7f6f4aa00640 1 --2- 172.21.15.46:0/885249483 >> v2:172.21.15.162:3300/0 conn(0x7f6f4c155df0 0x7f6f4c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.572+0000 7f6f4aa00640 1 -- 172.21.15.46:0/885249483 >> v1:172.21.15.162:6789/0 conn(0x7f6f4c06d7f0 legacy=0x7f6f4c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.572+0000 7f6f4aa00640 1 -- 172.21.15.46:0/885249483 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c06e8c0 con 0x7f6f4c155a20 2024-08-17T02:27:53.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.573+0000 7f6f4aa00640 1 --2- 172.21.15.46:0/885249483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c155a20 0x7f6f4c0adf10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c06aa10 tx=0x7f6f3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b511858c4e7a6ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.573+0000 7f6f49600640 1 -- 172.21.15.46:0/885249483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c02ae80 con 0x7f6f4c155a20 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.573+0000 7f6f49600640 1 -- 172.21.15.46:0/885249483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c032440 con 0x7f6f4c155a20 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.573+0000 7f6f49600640 1 -- 172.21.15.46:0/885249483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c032800 con 0x7f6f4c155a20 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 -- 172.21.15.46:0/885249483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c155a20 msgr2=0x7f6f4c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 --2- 172.21.15.46:0/885249483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c155a20 0x7f6f4c0adf10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c06aa10 tx=0x7f6f3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 -- 172.21.15.46:0/885249483 shutdown_connections 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 --2- 172.21.15.46:0/885249483 >> v2:172.21.15.162:3300/0 conn(0x7f6f4c155df0 0x7f6f4c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 --2- 172.21.15.46:0/885249483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c155a20 0x7f6f4c0adf10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 -- 172.21.15.46:0/885249483 >> 172.21.15.46:0/885249483 conn(0x7f6f4c0cb9b0 msgr2=0x7f6f4c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 -- 172.21.15.46:0/885249483 shutdown_connections 2024-08-17T02:27:53.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.574+0000 7f6f51c00640 1 -- 172.21.15.46:0/885249483 wait complete. 2024-08-17T02:27:53.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.575+0000 7f6f51c00640 1 Processor -- start 2024-08-17T02:27:53.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 -- start start 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f4c155a20 0x7f6f4c165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 0x7f6f4c0a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0a7850 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1658d0 con 0x7f6f4c155a20 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.576+0000 7f6f51c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c165ba0 con 0x7f6f4c155df0 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60788/0 (socket says 172.21.15.46:60788) 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 -- 172.21.15.46:0/2248791157 learned_addr learned my addr 172.21.15.46:0/2248791157 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4a000640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f4c155a20 0x7f6f4c165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4b400640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 0x7f6f4c0a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 -- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 msgr2=0x7f6f4c0a9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 0x7f6f4c0a9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 -- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f4c155a20 msgr2=0x7f6f4c165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f4c155a20 0x7f6f4c165390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 -- 172.21.15.46:0/2248791157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c009450 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4b400640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 0x7f6f4c0a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.577+0000 7f6f4aa00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009210 tx=0x7f6f3c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.578+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c000d10 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.578+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c031de0 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.578+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c03d690 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.578+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c165e80 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.578+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c0a9a90 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.579+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c0a7620 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.580+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f3c039040 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.580+0000 7f6f42000640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 0x7f6f2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.581+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f3c0a2320 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.581+0000 7f6f4a000640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 0x7f6f2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.582+0000 7f6f4a000640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 0x7f6f2c067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0aa980 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.584+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f3c070490 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.805+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f4c064db0 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.806+0000 7f6f42000640 1 -- 172.21.15.46:0/2248791157 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f6f3c073ab0 con 0x7f6f4c06d7f0 2024-08-17T02:27:53.805 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:27:53.805 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:53.806 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:27:53.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.807+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 msgr2=0x7f6f2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.807+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 0x7f6f2c067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0aa980 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.807+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 msgr2=0x7f6f4c0a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.807+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009210 tx=0x7f6f3c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 shutdown_connections 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6f2c065150 0x7f6f2c067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f4c155df0 0x7f6f4c0a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f4c155a20 0x7f6f4c165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 --2- 172.21.15.46:0/2248791157 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f4c06d7f0 0x7f6f4c0a8de0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 >> 172.21.15.46:0/2248791157 conn(0x7f6f4c0cb9b0 msgr2=0x7f6f4c1529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 shutdown_connections 2024-08-17T02:27:53.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:53.808+0000 7f6f51c00640 1 -- 172.21.15.46:0/2248791157 wait complete. 2024-08-17T02:27:54.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:38.638262+0000', 'modified': '2024-08-17T02:27:42.214800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6837/2952404167', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 2952404167}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 2952404167}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:27:54.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:27:54.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:27:54.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.382+0000 7f50f3400640 1 Processor -- start 2024-08-17T02:27:54.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.382+0000 7f50f3400640 1 -- start start 2024-08-17T02:27:54.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.383+0000 7f50f3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50ec0b1440 0x7f50ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.383+0000 7f50f3400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0caa80 con 0x7f50ec1401b0 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.383+0000 7f50f3400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50ec0c9e70 con 0x7f50ec140580 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.383+0000 7f50f3400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50ec0cb450 con 0x7f50ec0b1440 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50ebe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50ec0b1440 0x7f50ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50f0a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f50ec1401b0 0x7f50ec0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43396/0 (socket says 172.21.15.46:43396) 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50ebe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f50ec0b1440 0x7f50ec0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60800/0 (socket says 172.21.15.46:60800) 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50f0a00640 1 -- 172.21.15.46:0/4068057456 learned_addr learned my addr 172.21.15.46:0/4068057456 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:54.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50ebe00640 1 -- 172.21.15.46:0/4068057456 >> v1:172.21.15.162:6789/0 conn(0x7f50ec140580 legacy=0x7f50ec0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50ebe00640 1 -- 172.21.15.46:0/4068057456 >> v1:172.21.15.46:6789/0 conn(0x7f50ec1401b0 legacy=0x7f50ec0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50ebe00640 1 -- 172.21.15.46:0/4068057456 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec0ca150 con 0x7f50ec0b1440 2024-08-17T02:27:54.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.384+0000 7f50eb400640 1 -- 172.21.15.46:0/4068057456 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587531858 0 0) 0x7f50ec0caa80 con 0x7f50ec1401b0 2024-08-17T02:27:54.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.385+0000 7f50ebe00640 1 --2- 172.21.15.46:0/4068057456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec0b1440 0x7f50ec0caf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009850 tx=0x7f50d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4331cbb467a3498d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.385+0000 7f50eb400640 1 -- 172.21.15.46:0/4068057456 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d802adb0 con 0x7f50ec0b1440 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.385+0000 7f50eb400640 1 -- 172.21.15.46:0/4068057456 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8032440 con 0x7f50ec0b1440 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.385+0000 7f50eb400640 1 -- 172.21.15.46:0/4068057456 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80327e0 con 0x7f50ec0b1440 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 -- 172.21.15.46:0/4068057456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec0b1440 msgr2=0x7f50ec0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 --2- 172.21.15.46:0/4068057456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec0b1440 0x7f50ec0caf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009850 tx=0x7f50d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 -- 172.21.15.46:0/4068057456 shutdown_connections 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 --2- 172.21.15.46:0/4068057456 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec0b1440 0x7f50ec0caf10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 -- 172.21.15.46:0/4068057456 >> 172.21.15.46:0/4068057456 conn(0x7f50ec0cb9b0 msgr2=0x7f50ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 -- 172.21.15.46:0/4068057456 shutdown_connections 2024-08-17T02:27:54.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.386+0000 7f50f3400640 1 -- 172.21.15.46:0/4068057456 wait complete. 2024-08-17T02:27:54.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.387+0000 7f50f3400640 1 Processor -- start 2024-08-17T02:27:54.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 -- start start 2024-08-17T02:27:54.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 0x7f50ec0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50ec140580 0x7f50ec156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0c5f60 con 0x7f50ec1401b0 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0c5350 con 0x7f50ec0b1440 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.388+0000 7f50f3400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec0c5630 con 0x7f50ec140580 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60816/0 (socket says 172.21.15.46:60816) 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 -- 172.21.15.46:0/2513227377 learned_addr learned my addr 172.21.15.46:0/2513227377 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50f0a00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 0x7f50ec0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50f1400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50ec140580 0x7f50ec156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 -- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50ec140580 msgr2=0x7f50ec156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50ec140580 0x7f50ec156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 -- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 msgr2=0x7f50ec0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 0x7f50ec0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 -- 172.21.15.46:0/2513227377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d8009390 con 0x7f50ec1401b0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50f0a00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 0x7f50ec0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.389+0000 7f50ebe00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009360 tx=0x7f50d8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.390+0000 7f50dfe00640 1 -- 172.21.15.46:0/2513227377 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8031b30 con 0x7f50ec1401b0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.390+0000 7f50dfe00640 1 -- 172.21.15.46:0/2513227377 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8031c90 con 0x7f50ec1401b0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.390+0000 7f50dfe00640 1 -- 172.21.15.46:0/2513227377 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d803b630 con 0x7f50ec1401b0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.390+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec0c5910 con 0x7f50ec1401b0 2024-08-17T02:27:54.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.390+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec0b0a70 con 0x7f50ec1401b0 2024-08-17T02:27:54.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.392+0000 7f50dfe00640 1 -- 172.21.15.46:0/2513227377 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50d8043030 con 0x7f50ec1401b0 2024-08-17T02:27:54.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.392+0000 7f50dfe00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 0x7f50cc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.392+0000 7f50dfe00640 1 -- 172.21.15.46:0/2513227377 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d8041070 con 0x7f50ec1401b0 2024-08-17T02:27:54.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.393+0000 7f50f0a00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 0x7f50cc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.393+0000 7f50f59a5740 1 Processor -- start 2024-08-17T02:27:54.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 -- start start 2024-08-17T02:27:54.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f0a00640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 0x7f50cc0676d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50e00011e0 tx=0x7f50e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 0x5637e3811e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e37e6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e37a7380 con 0x5637e37ed0a0 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e37509e0 con 0x5637e382fb10 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.394+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e374e170 con 0x5637e3811a30 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60830/0 (socket says 172.21.15.46:60830) 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 -- 172.21.15.46:0/1769313204 learned_addr learned my addr 172.21.15.46:0/1769313204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50f1400640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e37e6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50f0a00640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 0x5637e3811e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 -- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 msgr2=0x5637e3811e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 0x5637e3811e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 -- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 msgr2=0x5637e37e6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e37e6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 -- 172.21.15.46:0/1769313204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e36fd820 con 0x5637e37ed0a0 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50f0a00640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 0x5637e3811e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50ebe00640 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f50d80098b0 tx=0x7f50d80a1180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2020618ddb6fff3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.395+0000 7f50dcc00640 1 -- 172.21.15.46:0/1769313204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8074bb0 con 0x5637e37ed0a0 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50dcc00640 1 -- 172.21.15.46:0/1769313204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8077d50 con 0x5637e37ed0a0 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50dcc00640 1 -- 172.21.15.46:0/1769313204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d807baa0 con 0x5637e37ed0a0 2024-08-17T02:27:54.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 -- 172.21.15.46:0/1769313204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 msgr2=0x5637e382f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f50d80098b0 tx=0x7f50d80a1180 comp rx=0 tx=0).stop 2024-08-17T02:27:54.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 -- 172.21.15.46:0/1769313204 shutdown_connections 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e37e6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e382f5d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1769313204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e3811a30 0x5637e3811e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 -- 172.21.15.46:0/1769313204 >> 172.21.15.46:0/1769313204 conn(0x5637e3785030 msgr2=0x5637e3833c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 -- 172.21.15.46:0/1769313204 shutdown_connections 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.396+0000 7f50f59a5740 1 -- 172.21.15.46:0/1769313204 wait complete. 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.397+0000 7f50f59a5740 1 -- start start 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.397+0000 7f50f59a5740 1 Processor -- start 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e38190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e382d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e3749f60 con 0x5637e3811a30 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e36f2690 con 0x5637e382fb10 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e36f2330 con 0x5637e37ed0a0 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f59a5740 10 client.0 _ll_register_callbacks cb 0x5637e36ec2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50ebe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60836/0 (socket says 172.21.15.46:60836) 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50ebe00640 1 -- 172.21.15.46:0/3805123383 learned_addr learned my addr 172.21.15.46:0/3805123383 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e38190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.398+0000 7f50f1400640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e382d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 -- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 msgr2=0x5637e38190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e38190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 -- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 msgr2=0x5637e382d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e382d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 -- 172.21.15.46:0/3805123383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec0b0a70 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50ebe00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009130 tx=0x7f50d8088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ed299a00d88a00 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50d1600640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d807baa0 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d8031e00 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637e377dd20 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d80742b0 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50f59a5740 10 client.4623 fetch_fsmap learned FSMap version 8 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.399+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5637e3713ab0 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637e377dd20 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50d807b610 con 0x5637e3811a30 2024-08-17T02:27:54.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 10 client.4623 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 20 client.4623 populate_metadata read hostname 'smithi046' 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3817900 0x5637e3817cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 4 client.4623 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 --> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637e34513c0 con 0x5637e3817900 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.400+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3817900 0x5637e3817cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.401+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3817900 0x5637e3817cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33eb52ae6d55ea7f server_cookie=74a6bd598b194845 in_seq=0 out_seq=0 2024-08-17T02:27:54.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.401+0000 7f50d1600640 10 client.4623 ms_handle_connect on v2:172.21.15.162:6836/2952404167 2024-08-17T02:27:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50d1600640 1 -- 172.21.15.46:0/3805123383 <== mds.0 v2:172.21.15.162:6836/2952404167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5637e34513c0 con 0x5637e3817900 2024-08-17T02:27:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50d1600640 10 client.4623 handle_command_reply: tid=0 2024-08-17T02:27:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 client.4623 shutdown 2024-08-17T02:27:54.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 msgr2=0x5637e38152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009130 tx=0x7f50d8088000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 shutdown_connections 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e382fb10 0x5637e382d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e3811a30 0x5637e38152c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3817900 0x5637e3817cd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3805123383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e38190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 >> 172.21.15.46:0/3805123383 conn(0x5637e3785030 msgr2=0x5637e3833750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50d1600640 0 client.4623 ms_handle_reset on v2:172.21.15.162:6836/2952404167 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 shutdown_connections 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 1 -- 172.21.15.46:0/3805123383 wait complete. 2024-08-17T02:27:54.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.402+0000 7f50f59a5740 20 client.4623 trim_cache size 0 max 16384 2024-08-17T02:27:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.418+0000 7f50f59a5740 1 Processor -- start 2024-08-17T02:27:54.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.418+0000 7f50f59a5740 1 -- start start 2024-08-17T02:27:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e37e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 0x5637e382c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e34c4f20 con 0x5637e37ed0a0 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e384a430 con 0x5637e3811a30 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e37e9720 con 0x5637e382fb10 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60842/0 (socket says 172.21.15.46:60842) 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 -- 172.21.15.46:0/1152670135 learned_addr learned my addr 172.21.15.46:0/1152670135 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50ebe00640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e37e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f1400640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 0x5637e382c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 -- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 msgr2=0x5637e382c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 0x5637e382c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 -- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 msgr2=0x5637e37e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e37e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f0a00640 1 -- 172.21.15.46:0/1152670135 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637e3717490 con 0x5637e37ed0a0 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.419+0000 7f50f1400640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 0x5637e382c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f0a00640 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5637e38167b0 tx=0x7f50e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bd4df31f9e9456 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50dd600640 1 -- 172.21.15.46:0/1152670135 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00076f0 con 0x5637e37ed0a0 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50dd600640 1 -- 172.21.15.46:0/1152670135 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00260e0 con 0x5637e37ed0a0 2024-08-17T02:27:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50dd600640 1 -- 172.21.15.46:0/1152670135 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00267f0 con 0x5637e37ed0a0 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 -- 172.21.15.46:0/1152670135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 msgr2=0x5637e3833800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x5637e38167b0 tx=0x7f50e0013000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 -- 172.21.15.46:0/1152670135 shutdown_connections 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e382fb10 0x5637e382c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e37e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 --2- 172.21.15.46:0/1152670135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e37ed0a0 0x5637e3833800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 -- 172.21.15.46:0/1152670135 >> 172.21.15.46:0/1152670135 conn(0x5637e3785030 msgr2=0x5637e3849990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.420+0000 7f50f59a5740 1 -- 172.21.15.46:0/1152670135 shutdown_connections 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.421+0000 7f50f59a5740 1 -- 172.21.15.46:0/1152670135 wait complete. 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.421+0000 7f50f59a5740 1 -- start start 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.421+0000 7f50f59a5740 1 Processor -- start 2024-08-17T02:27:54.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e3896cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e384e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e3811530 con 0x5637e382fb10 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637e3813cb0 con 0x5637e3811a30 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637e38510f0 con 0x5637e37ed0a0 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f59a5740 10 client.0 _ll_register_callbacks cb 0x7f50e40038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60846/0 (socket says 172.21.15.46:60846) 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.422+0000 7f50f1400640 1 -- 172.21.15.46:0/3144668302 learned_addr learned my addr 172.21.15.46:0/3144668302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50ebe00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e384e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e3896cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 -- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 msgr2=0x5637e3896cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e3896cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 -- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 msgr2=0x5637e384e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e384e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 -- 172.21.15.46:0/3144668302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e001d040 con 0x5637e382fb10 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e3896cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50ebe00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e384e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f1400640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50e40169c0 tx=0x7f50e4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0e8ea1ad35f897 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50d1600640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e4014920 con 0x5637e382fb10 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50e4021af0 con 0x5637e382fb10 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50d8077d50 con 0x5637e382fb10 2024-08-17T02:27:54.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50e4014a80 con 0x5637e382fb10 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.423+0000 7f50f59a5740 10 client.4629 fetch_fsmap learned FSMap version 8 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5637e37171e0 con 0x5637e382fb10 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8077d50 con 0x5637e382fb10 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f50e4012040 con 0x5637e382fb10 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 20 client.4629 populate_metadata read hostname 'smithi046' 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3897980 0x5637e3897d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 4 client.4629 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 --> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5637e34626c0 con 0x5637e3897980 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.424+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3897980 0x5637e3897d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f0a00640 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3897980 0x5637e3897d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa01be4128f663d server_cookie=dd78c4e351acc7ed in_seq=0 out_seq=0 2024-08-17T02:27:54.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50d1600640 10 client.4629 ms_handle_connect on v2:172.21.15.162:6836/2952404167 2024-08-17T02:27:54.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50d1600640 1 -- 172.21.15.46:0/3144668302 <== mds.0 v2:172.21.15.162:6836/2952404167 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5637e34626c0 con 0x5637e3897980 2024-08-17T02:27:54.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50d1600640 10 client.4629 handle_command_reply: tid=0 2024-08-17T02:27:54.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 client.4629 shutdown 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 msgr2=0x5637e384ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50e40169c0 tx=0x7f50e4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 shutdown_connections 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5637e382fb10 0x5637e384ef00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5637e3811a30 0x5637e384e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:6836/2952404167,v1:172.21.15.162:6837/2952404167] conn(0x5637e3897980 0x5637e3897d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 --2- 172.21.15.46:0/3144668302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5637e37ed0a0 0x5637e3896cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 >> 172.21.15.46:0/3144668302 conn(0x5637e3785030 msgr2=0x5637e3818c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.425+0000 7f50d1600640 0 client.4629 ms_handle_reset on v2:172.21.15.162:6836/2952404167 2024-08-17T02:27:54.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 shutdown_connections 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f59a5740 1 -- 172.21.15.46:0/3144668302 wait complete. 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f59a5740 20 client.4629 trim_cache size 0 max 16384 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "cdf034cd-9476-4b1b-a305-19ec575459d2", 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4270, 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-08-17T02:27:54.431 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 15.216740299, 2024-08-17T02:27:54.432 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 8, 2024-08-17T02:27:54.432 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 21, 2024-08-17T02:27:54.432 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 21, 2024-08-17T02:27:54.432 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 22.361328865000001 2024-08-17T02:27:54.432 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 msgr2=0x7f50cc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 0x7f50cc0676d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50e00011e0 tx=0x7f50e0009040 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 msgr2=0x7f50ec156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009360 tx=0x7f50d8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 shutdown_connections 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f50cc065220 0x7f50cc0676d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50ec140580 0x7f50ec156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50ec1401b0 0x7f50ec156480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 --2- 172.21.15.46:0/2513227377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50ec0b1440 0x7f50ec0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.426+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 >> 172.21.15.46:0/2513227377 conn(0x7f50ec0cb9b0 msgr2=0x7f50ec0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.427+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 shutdown_connections 2024-08-17T02:27:54.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:54.427+0000 7f50f3400640 1 -- 172.21.15.46:0/2513227377 wait complete. 2024-08-17T02:27:54.440 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:27:54.465 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:27:54.465 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:27:54.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.466 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:27:54.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-08-17T02:27:54.600 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:54.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:54.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.604 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:27:54.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-08-17T02:27:54.737 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:54.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:54.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.740 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:27:54.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-17T02:27:54.885 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:54.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:54.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.888 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:27:54.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:54.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-17T02:27:55.023 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-17T02:27:55.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:27:55.025 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:27:55.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:55.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.178+0000 7fcea0e00640 1 Processor -- start 2024-08-17T02:27:55.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.178+0000 7fcea0e00640 1 -- start start 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 0x7fce9c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fcea0e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce9c158ea0 0x7fce9c0af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fcea0e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c067d60 con 0x7fce9c158ad0 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fcea0e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c068600 con 0x7fce9c158ea0 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fcea0e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c0b01d0 con 0x7fce9c0ac780 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fce9b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fce9c158ad0 0x7fce9c0ac070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43412/0 (socket says 172.21.15.46:43412) 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fce9b400640 1 -- 172.21.15.46:0/3751011941 learned_addr learned my addr 172.21.15.46:0/3751011941 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.179+0000 7fce92a00640 1 --2- 172.21.15.46:0/3751011941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 0x7fce9c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce9be00640 1 --2- 172.21.15.46:0/3751011941 >> v2:172.21.15.162:3300/0 conn(0x7fce9c158ea0 0x7fce9c0af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622586018 0 0) 0x7fce9c067d60 con 0x7fce9c158ad0 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce800034e0 con 0x7fce9c158ad0 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce92a00640 1 -- 172.21.15.46:0/3751011941 >> v2:172.21.15.162:3300/0 conn(0x7fce9c158ea0 msgr2=0x7fce9c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce92a00640 1 --2- 172.21.15.46:0/3751011941 >> v2:172.21.15.162:3300/0 conn(0x7fce9c158ea0 0x7fce9c0af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce92a00640 1 -- 172.21.15.46:0/3751011941 >> v1:172.21.15.46:6789/0 conn(0x7fce9c158ad0 legacy=0x7fce9c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2673110840 0 0) 0x7fce800034e0 con 0x7fce9c158ad0 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.180+0000 7fce92a00640 1 -- 172.21.15.46:0/3751011941 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c067fb0 con 0x7fce9c0ac780 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.181+0000 7fce92a00640 1 --2- 172.21.15.46:0/3751011941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 0x7fce9c0af410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce84009850 tx=0x7fce840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30d5fc279e1f0c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.181+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c001470 con 0x7fce9c0ac780 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8402a930 con 0x7fce9c0ac780 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fce9aa00640 1 -- 172.21.15.46:0/3751011941 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8402acb0 con 0x7fce9c0ac780 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 -- 172.21.15.46:0/3751011941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 msgr2=0x7fce9c0af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 --2- 172.21.15.46:0/3751011941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 0x7fce9c0af410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fce84009850 tx=0x7fce840090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 -- 172.21.15.46:0/3751011941 shutdown_connections 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 --2- 172.21.15.46:0/3751011941 >> v2:172.21.15.162:3300/0 conn(0x7fce9c158ea0 0x7fce9c0af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 --2- 172.21.15.46:0/3751011941 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c0ac780 0x7fce9c0af410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 -- 172.21.15.46:0/3751011941 >> 172.21.15.46:0/3751011941 conn(0x7fce9c096a70 msgr2=0x7fce9c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 -- 172.21.15.46:0/3751011941 shutdown_connections 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.182+0000 7fcea0e00640 1 -- 172.21.15.46:0/3751011941 wait complete. 2024-08-17T02:27:55.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.183+0000 7fcea0e00640 1 Processor -- start 2024-08-17T02:27:55.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.184+0000 7fcea0e00640 1 -- start start 2024-08-17T02:27:55.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.184+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.184+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c158ad0 0x7fce9c15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.184+0000 7fcea0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c158ea0 0x7fce9c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fcea0e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c15b820 con 0x7fce9c0ac780 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fcea0e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c15e2e0 con 0x7fce9c158ea0 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fcea0e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c15b4d0 con 0x7fce9c158ad0 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60862/0 (socket says 172.21.15.46:60862) 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 -- 172.21.15.46:0/4085892882 learned_addr learned my addr 172.21.15.46:0/4085892882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce92a00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c158ad0 0x7fce9c15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9be00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c158ea0 0x7fce9c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 -- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c158ad0 msgr2=0x7fce9c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c158ad0 0x7fce9c15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 -- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c158ea0 msgr2=0x7fce9c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c158ea0 0x7fce9c154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.185+0000 7fce9b400640 1 -- 172.21.15.46:0/4085892882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009390 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fce9b400640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00cb90 tx=0x7fce8c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007360 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c0074c0 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007670 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c0cc790 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.186+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c0ccd50 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.187+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c071050 con 0x7fce9c0ac780 2024-08-17T02:27:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.188+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce8c004cc0 con 0x7fce9c0ac780 2024-08-17T02:27:55.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.189+0000 7fce93400640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 0x7fce78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.189+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce8c081940 con 0x7fce9c0ac780 2024-08-17T02:27:55.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.189+0000 7fce92a00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 0x7fce78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.190+0000 7fce92a00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 0x7fce78067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce84032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.192+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fce8c04fb50 con 0x7fce9c0ac780 2024-08-17T02:27:55.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.411+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce9c0ab0f0 con 0x7fce9c0ac780 2024-08-17T02:27:55.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.412+0000 7fce93400640 1 -- 172.21.15.46:0/4085892882 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce8c018070 con 0x7fce9c0ac780 2024-08-17T02:27:55.412 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:55.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 msgr2=0x7fce78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 0x7fce78067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fce84034000 tx=0x7fce84032000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 msgr2=0x7fce9c0cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00cb90 tx=0x7fce8c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 shutdown_connections 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9c158ea0 0x7fce9c154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fce78065150 0x7fce78067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce9c158ad0 0x7fce9c15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 --2- 172.21.15.46:0/4085892882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce9c0ac780 0x7fce9c0cc120 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.414+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 >> 172.21.15.46:0/4085892882 conn(0x7fce9c096a70 msgr2=0x7fce9c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.415+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 shutdown_connections 2024-08-17T02:27:55.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:55.415+0000 7fcea0e00640 1 -- 172.21.15.46:0/4085892882 wait complete. 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:55.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:55.430 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:55.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.430 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:55.465 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42640sec preferred_lft 42640sec 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-08-17T02:27:55.466 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:55.467 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:55.467 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:55.467 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-08-17T02:27:55.467 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:27:55.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.467 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:55.467 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:55.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:27:55.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-08-17T02:27:55.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-08-17T02:27:55.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:27:55.468 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:55.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.835 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:55.892 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-08-17T02:27:55.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.896 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-08-17T02:27:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-08-17T02:27:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:27:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:27:55.949 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:55.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:55.950 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:56.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.483 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:27:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.520 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-08-17T02:27:56.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.596 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:56.596 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:56.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:56.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:27:56.596 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:56.723 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:27:56.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.724 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:56.724 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:56.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:27:56.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:56.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:27:56.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:27:56.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:27:56.725 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:56.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:56.918 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:56.918 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:56.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-08-17T02:27:56.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:27:56.919 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:57.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:57.035 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:57.071 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:27:57.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:57.071 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:57.145 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:27:57.146 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:57.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:57.892 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:57.893 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:57.893 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:27:57.893 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:27:57.894 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:27:57.894 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:27:57.894 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:57.895 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:57.895 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:57.895 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:57.898 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:57.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:57.898 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:27:57.955 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:27:57.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:58.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.109+0000 7f4fc1c00640 1 Processor -- start 2024-08-17T02:27:58.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.109+0000 7f4fc1c00640 1 -- start start 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fc1c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4fbc0aea20 0x7f4fbc0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fc1c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4fbc155180 0x7f4fbc0acba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fc1c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fbc0afc10 con 0x7f4fbc155600 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fc1c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0aedf0 con 0x7f4fbc155180 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fc1c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0ae5b0 con 0x7f4fbc0aea20 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fb3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4fbc155180 0x7f4fbc0acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fbb400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4fbc155600 0x7f4fbc0ad0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43424/0 (socket says 172.21.15.46:43424) 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fb3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4fbc155180 0x7f4fbc0acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60874/0 (socket says 172.21.15.46:60874) 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.110+0000 7f4fbb400640 1 -- 172.21.15.46:0/4250075898 learned_addr learned my addr 172.21.15.46:0/4250075898 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fbaa00640 1 --2- 172.21.15.46:0/4250075898 >> v2:172.21.15.162:3300/0 conn(0x7f4fbc0aea20 0x7f4fbc0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fb3e00640 1 -- 172.21.15.46:0/4250075898 >> v2:172.21.15.162:3300/0 conn(0x7f4fbc0aea20 msgr2=0x7f4fbc0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fb3e00640 1 --2- 172.21.15.46:0/4250075898 >> v2:172.21.15.162:3300/0 conn(0x7f4fbc0aea20 0x7f4fbc0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fb3e00640 1 -- 172.21.15.46:0/4250075898 >> v1:172.21.15.46:6789/0 conn(0x7f4fbc155600 legacy=0x7f4fbc0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fb3e00640 1 -- 172.21.15.46:0/4250075898 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0af000 con 0x7f4fbc155180 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.111+0000 7f4fba000640 1 -- 172.21.15.46:0/4250075898 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672336519 0 0) 0x7f4fbc0afc10 con 0x7f4fbc155600 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.112+0000 7f4fb3e00640 1 --2- 172.21.15.46:0/4250075898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc0acba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06bc00 tx=0x7f4fa40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e0c0bb13a60e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.112+0000 7f4fba000640 1 -- 172.21.15.46:0/4250075898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa402ad20 con 0x7f4fbc155180 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.112+0000 7f4fba000640 1 -- 172.21.15.46:0/4250075898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa402ae80 con 0x7f4fbc155180 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.112+0000 7f4fba000640 1 -- 172.21.15.46:0/4250075898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4032670 con 0x7f4fbc155180 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 -- 172.21.15.46:0/4250075898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 msgr2=0x7f4fbc0acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/4250075898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc0acba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc06bc00 tx=0x7f4fa40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 -- 172.21.15.46:0/4250075898 shutdown_connections 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/4250075898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc0acba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/4250075898 >> v2:172.21.15.162:3300/0 conn(0x7f4fbc0aea20 0x7f4fbc0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 -- 172.21.15.46:0/4250075898 >> 172.21.15.46:0/4250075898 conn(0x7f4fbc0cb9b0 msgr2=0x7f4fbc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 -- 172.21.15.46:0/4250075898 shutdown_connections 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.113+0000 7f4fc1c00640 1 -- 172.21.15.46:0/4250075898 wait complete. 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.114+0000 7f4fc1c00640 1 Processor -- start 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 -- start start 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fbc0aea20 0x7f4fbc1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fbc155600 0x7f4fbc149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc14b4d0 con 0x7f4fbc155180 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc156b50 con 0x7f4fbc155600 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.115+0000 7f4fc1c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc157110 con 0x7f4fbc0aea20 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60876/0 (socket says 172.21.15.46:60876) 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 -- 172.21.15.46:0/2944635141 learned_addr learned my addr 172.21.15.46:0/2944635141 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fbb400640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fbc155600 0x7f4fbc149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fbaa00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fbc0aea20 0x7f4fbc1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 -- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fbc0aea20 msgr2=0x7f4fbc1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fbc0aea20 0x7f4fbc1404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 -- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fbc155600 msgr2=0x7f4fbc149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fbc155600 0x7f4fbc149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.116+0000 7f4fb3e00640 1 -- 172.21.15.46:0/2944635141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009390 con 0x7f4fbc155180 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fb3e00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009360 tx=0x7f4fa4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa403b6e0 con 0x7f4fbc155180 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa403b840 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa403bc00 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc14c950 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.117+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc156da0 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.118+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc064db0 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.119+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4fa4039040 con 0x7f4fbc155180 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.119+0000 7f4fb2000640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 0x7f4f98067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.120+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4fa40a24f0 con 0x7f4fbc155180 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.120+0000 7f4fbaa00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 0x7f4f98067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.121+0000 7f4fbaa00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 0x7f4f98067630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009d20 tx=0x7f4fac0090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.124+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4fa4070680 con 0x7f4fbc155180 2024-08-17T02:27:58.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.345+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4fbc068f80 con 0x7f4fbc155180 2024-08-17T02:27:58.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.346+0000 7f4fb2000640 1 -- 172.21.15.46:0/2944635141 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4fa4073ca0 con 0x7f4fbc155180 2024-08-17T02:27:58.346 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 msgr2=0x7f4f98067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 0x7f4f98067630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009d20 tx=0x7f4fac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 msgr2=0x7f4fbc149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009360 tx=0x7f4fa4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 shutdown_connections 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fbc155600 0x7f4fbc149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fbc155180 0x7f4fbc149700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4f98065180 0x7f4f98067630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 --2- 172.21.15.46:0/2944635141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fbc0aea20 0x7f4fbc1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 >> 172.21.15.46:0/2944635141 conn(0x7f4fbc0cb9b0 msgr2=0x7f4fbc06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 shutdown_connections 2024-08-17T02:27:58.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:58.348+0000 7f4fc1c00640 1 -- 172.21.15.46:0/2944635141 wait complete. 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:27:58.363 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:58.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.363 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-08-17T02:27:58.399 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:58.399 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-08-17T02:27:58.400 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42637sec preferred_lft 42637sec 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether c6:d8:8c:56:eb:42 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.401 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::7455:16ff:fe3a:8056/64 scope link 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether c6:d8:8c:56:eb:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::c4d8:8cff:fe56:eb42/64 scope link tentative 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.402 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:27:58.494 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-08-17T02:27:58.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.497 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:27:58.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:58.534 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:58.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:27:58.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:27:58.534 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:27:58.534 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:58.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.679 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:27:58.714 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:27:58.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.715 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-08-17T02:27:58.789 INFO:teuthology.orchestra.run.smithi046.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:27:58.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.790 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:58.790 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:58.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:27:58.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:27:58.790 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:58.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:58.971 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:58.971 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:58.971 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 96:be:11:08:fe:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::94be:11ff:fe08:fef4/64 scope link 2024-08-17T02:27:58.972 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:58.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:58.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:27:59.030 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:27:59.030 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:27:59.030 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 96:be:11:08:fe:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::94be:11ff:fe08:fef4/64 scope link 2024-08-17T02:27:59.031 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:27:59.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:27:59.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:27:59.034 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:59.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:59.201 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:27:59.201 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:27:59.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.1 up 2024-08-17T02:27:59.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:27:59.201 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:27:59.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:59.317 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:59.352 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:27:59.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:27:59.352 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:59.427 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:27:59.427 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:27:59.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:59.549 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:59.549 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 2@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:27:59.578 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:27:59.579 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:27:59.579 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:27:59.579 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:27:59.579 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:27:59.582 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:27:59.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:27:59.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:27:59.638 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:27:59.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:27:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.788+0000 7f6cfb200640 1 Processor -- start 2024-08-17T02:27:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.788+0000 7f6cfb200640 1 -- start start 2024-08-17T02:27:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6cfc159ca0 0x7f6cfc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0cd6e0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0ccf70 con 0x7f6cfc159ca0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0cadc0 con 0x7f6cfc0ca8a0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfa800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfa800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60880/0 (socket says 172.21.15.46:60880) 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cfa800640 1 -- 172.21.15.46:0/1684531621 learned_addr learned my addr 172.21.15.46:0/1684531621 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cf9e00640 1 --2- 172.21.15.46:0/1684531621 >> v2:172.21.15.162:3300/0 conn(0x7f6cfc159ca0 0x7f6cfc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.789+0000 7f6cf3e00640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cfa800640 1 -- 172.21.15.46:0/1684531621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 msgr2=0x7f6cfc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cfa800640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cfa800640 1 -- 172.21.15.46:0/1684531621 >> v2:172.21.15.162:3300/0 conn(0x7f6cfc159ca0 msgr2=0x7f6cfc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cfa800640 1 --2- 172.21.15.46:0/1684531621 >> v2:172.21.15.162:3300/0 conn(0x7f6cfc159ca0 0x7f6cfc0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cfa800640 1 -- 172.21.15.46:0/1684531621 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0cb060 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.790+0000 7f6cf3e00640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfa800640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc08a320 tx=0x7f6cf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9145826c8ffe940 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cf9400640 1 -- 172.21.15.46:0/1684531621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4031400 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cf9400640 1 -- 172.21.15.46:0/1684531621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf402d050 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cf9400640 1 -- 172.21.15.46:0/1684531621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40317d0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 -- 172.21.15.46:0/1684531621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 msgr2=0x7f6cfc0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc08a320 tx=0x7f6cf4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 -- 172.21.15.46:0/1684531621 shutdown_connections 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0cdb30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1684531621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.791+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1684531621 >> v2:172.21.15.162:3300/0 conn(0x7f6cfc159ca0 0x7f6cfc0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.792+0000 7f6cfb200640 1 -- 172.21.15.46:0/1684531621 >> 172.21.15.46:0/1684531621 conn(0x7f6cfc098e00 msgr2=0x7f6cfc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.792+0000 7f6cfb200640 1 -- 172.21.15.46:0/1684531621 shutdown_connections 2024-08-17T02:27:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.792+0000 7f6cfb200640 1 -- 172.21.15.46:0/1684531621 wait complete. 2024-08-17T02:27:59.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.793+0000 7f6cfb200640 1 Processor -- start 2024-08-17T02:27:59.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.793+0000 7f6cfb200640 1 -- start start 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc159ca0 0x7f6cfc155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c4540 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c8960 con 0x7f6cfc159ca0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfb200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c4730 con 0x7f6cfc0ca8a0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cf3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cf3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60888/0 (socket says 172.21.15.46:60888) 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cf3e00640 1 -- 172.21.15.46:0/1277477770 learned_addr learned my addr 172.21.15.46:0/1277477770 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cf9e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.794+0000 7f6cfa800640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc159ca0 0x7f6cfc155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 -- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 msgr2=0x7f6cfc0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 -- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc159ca0 msgr2=0x7f6cfc155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc159ca0 0x7f6cfc155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 -- 172.21.15.46:0/1277477770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf4009ae0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf3e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d890 tx=0x7f6ce4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400de80 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce400b8d0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400bc90 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc0c53a0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.795+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0c5960 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.796+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc071050 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.797+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ce401e460 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.798+0000 7f6cf1600640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 0x7f6cd8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.798+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ce40829e0 con 0x7f6cfc0ccad0 2024-08-17T02:27:59.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.799+0000 7f6cf9e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 0x7f6cd8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.799+0000 7f6cf9e00640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 0x7f6cd8067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc15d4c0 tx=0x7f6cec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:27:59.802+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6ce4050ab0 con 0x7f6cfc0ccad0 2024-08-17T02:28:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.021+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6cfc0cd450 con 0x7f6cfc0ccad0 2024-08-17T02:28:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.022+0000 7f6cf1600640 1 -- 172.21.15.46:0/1277477770 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ce40540d0 con 0x7f6cfc0ccad0 2024-08-17T02:28:00.023 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 msgr2=0x7f6cd8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 0x7f6cd8067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc15d4c0 tx=0x7f6cec008040 comp rx=0 tx=0).stop 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 msgr2=0x7f6cfc0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d890 tx=0x7f6ce4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 shutdown_connections 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc159ca0 0x7f6cfc155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cfc0ccad0 0x7f6cfc0c8420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6cd8065180 0x7f6cd8067630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 --2- 172.21.15.46:0/1277477770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cfc0ca8a0 0x7f6cfc0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 >> 172.21.15.46:0/1277477770 conn(0x7f6cfc098e00 msgr2=0x7f6cfc158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 shutdown_connections 2024-08-17T02:28:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:00.024+0000 7f6cfb200640 1 -- 172.21.15.46:0/1277477770 wait complete. 2024-08-17T02:28:00.039 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:00.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:00.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-08-17T02:28:00.039 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:00.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:00.040 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:00.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:00.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:00.040 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:00.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.040 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-08-17T02:28:00.080 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:00.080 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:00.081 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42639sec preferred_lft 42639sec 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:00.082 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:28:00.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.082 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:28:00.083 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:00.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.453 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:00.509 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-17T02:28:00.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.513 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-08-17T02:28:00.563 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-08-17T02:28:00.563 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:00.564 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:00.564 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:00.564 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:00.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:00.564 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:00.564 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:00.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:00.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:00.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:00.565 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:01.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.096 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:28:01.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.131 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-08-17T02:28:01.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.207 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:01.207 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:01.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:01.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:28:01.207 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:01.333 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:28:01.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:28:01.334 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:01.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:01.528 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:01.528 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:01.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-08-17T02:28:01.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:28:01.528 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:01.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:01.643 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:01.678 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:01.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:01.679 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:01.753 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:28:01.753 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:01.753 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:01.880 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:01.880 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:02.511 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:02.512 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:02.512 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:28:02.512 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 1@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:28:02.512 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:28:02.513 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:28:02.513 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:02.513 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:02.513 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:02.513 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:02.516 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:02.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:02.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:02.572 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:28:02.573 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.734+0000 7ff93b200640 1 Processor -- start 2024-08-17T02:28:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.734+0000 7ff93b200640 1 -- start start 2024-08-17T02:28:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.735+0000 7ff93b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.735+0000 7ff93b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff93c0ccad0 0x7ff93c162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.735+0000 7ff93b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0cadc0 con 0x7ff93c159ca0 2024-08-17T02:28:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.735+0000 7ff93b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0cd6e0 con 0x7ff93c0ccad0 2024-08-17T02:28:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.735+0000 7ff93b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0ccf70 con 0x7ff93c0ceb40 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:60778/0 (socket says 172.21.15.46:60778) 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 -- 172.21.15.46:0/2860821669 learned_addr learned my addr 172.21.15.46:0/2860821669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff93a800640 1 --2- 172.21.15.46:0/2860821669 >> v2:172.21.15.162:3300/0 conn(0x7ff93c0ccad0 0x7ff93c162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 -- 172.21.15.46:0/2860821669 >> v2:172.21.15.162:3300/0 conn(0x7ff93c0ccad0 msgr2=0x7ff93c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 --2- 172.21.15.46:0/2860821669 >> v2:172.21.15.162:3300/0 conn(0x7ff93c0ccad0 0x7ff93c162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 -- 172.21.15.46:0/2860821669 >> v1:172.21.15.162:6789/0 conn(0x7ff93c159ca0 legacy=0x7ff93c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.736+0000 7ff939400640 1 -- 172.21.15.46:0/2860821669 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0cb060 con 0x7ff93c0ceb40 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.737+0000 7ff939400640 1 --2- 172.21.15.46:0/2860821669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff928009910 tx=0x7ff9280091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f79d51a9145e3c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.737+0000 7ff938a00640 1 -- 172.21.15.46:0/2860821669 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92802ae40 con 0x7ff93c0ceb40 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff938a00640 1 -- 172.21.15.46:0/2860821669 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928032440 con 0x7ff93c0ceb40 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff938a00640 1 -- 172.21.15.46:0/2860821669 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928032820 con 0x7ff93c0ceb40 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 -- 172.21.15.46:0/2860821669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 msgr2=0x7ff93c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 --2- 172.21.15.46:0/2860821669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff928009910 tx=0x7ff9280091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 -- 172.21.15.46:0/2860821669 shutdown_connections 2024-08-17T02:28:02.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 --2- 172.21.15.46:0/2860821669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c0ceb40 0x7ff93c0cc590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 --2- 172.21.15.46:0/2860821669 >> v2:172.21.15.162:3300/0 conn(0x7ff93c0ccad0 0x7ff93c162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 -- 172.21.15.46:0/2860821669 >> 172.21.15.46:0/2860821669 conn(0x7ff93c098e00 msgr2=0x7ff93c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 -- 172.21.15.46:0/2860821669 shutdown_connections 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.738+0000 7ff93b200640 1 -- 172.21.15.46:0/2860821669 wait complete. 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.740+0000 7ff93b200640 1 Processor -- start 2024-08-17T02:28:02.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.740+0000 7ff93b200640 1 -- start start 2024-08-17T02:28:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.740+0000 7ff93b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff93c0ccad0 0x7ff93c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c159ca0 0x7ff93c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c154be0 con 0x7ff93c0ccad0 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0c51b0 con 0x7ff93c0ceb40 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0c5490 con 0x7ff93c159ca0 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff93c0ccad0 0x7ff93c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:40496/0 (socket says 172.21.15.46:40496) 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 -- 172.21.15.46:0/1461280448 learned_addr learned my addr 172.21.15.46:0/1461280448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff93a800640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c159ca0 0x7ff93c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 -- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c159ca0 msgr2=0x7ff93c1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c159ca0 0x7ff93c1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 -- 172.21.15.46:0/1461280448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff93c0ccad0 msgr2=0x7ff93c0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff93c0ccad0 0x7ff93c0c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.741+0000 7ff939400640 1 -- 172.21.15.46:0/1461280448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928009450 con 0x7ff93c0ceb40 2024-08-17T02:28:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff939400640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff928035040 tx=0x7ff928032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928031bb0 con 0x7ff93c0ceb40 2024-08-17T02:28:02.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928031d70 con 0x7ff93c0ceb40 2024-08-17T02:28:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92803d670 con 0x7ff93c0ceb40 2024-08-17T02:28:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0c5770 con 0x7ff93c0ceb40 2024-08-17T02:28:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.742+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0c5d30 con 0x7ff93c0ceb40 2024-08-17T02:28:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.743+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c0c5f20 con 0x7ff93c0ceb40 2024-08-17T02:28:02.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.744+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff928039040 con 0x7ff93c0ceb40 2024-08-17T02:28:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.745+0000 7ff931600640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 0x7ff91c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.745+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff92802ae40 con 0x7ff93c0ceb40 2024-08-17T02:28:02.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.745+0000 7ff939e00640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 0x7ff91c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.746+0000 7ff939e00640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 0x7ff91c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.751+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9280d3e40 con 0x7ff93c0ceb40 2024-08-17T02:28:02.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.975+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff93c071050 con 0x7ff93c0ceb40 2024-08-17T02:28:02.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.975+0000 7ff931600640 1 -- 172.21.15.46:0/1461280448 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff928037060 con 0x7ff93c0ceb40 2024-08-17T02:28:02.976 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 msgr2=0x7ff91c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 0x7ff91c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 msgr2=0x7ff93c0c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff928035040 tx=0x7ff928032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 shutdown_connections 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff91c065150 0x7ff91c067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff93c159ca0 0x7ff93c1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff93c0ceb40 0x7ff93c0c4b00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 --2- 172.21.15.46:0/1461280448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff93c0ccad0 0x7ff93c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 >> 172.21.15.46:0/1461280448 conn(0x7ff93c098e00 msgr2=0x7ff93c1589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 shutdown_connections 2024-08-17T02:28:02.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:02.978+0000 7ff93b200640 1 -- 172.21.15.46:0/1461280448 wait complete. 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:02.994 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:02.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:02.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:02.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:28:02.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:02.995 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-08-17T02:28:03.031 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6e:5d:91:6b:3b:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:03.032 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::b422:d6ff:fed6:bcc2/64 scope link 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6e:5d:91:6b:3b:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6c5d:91ff:fe6b:3b0b/64 scope link 2024-08-17T02:28:03.033 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.034 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:03.128 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-17T02:28:03.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.131 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-08-17T02:28:03.167 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-08-17T02:28:03.167 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:03.167 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:03.168 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:03.168 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:03.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.168 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:03.168 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:03.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:03.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:03.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:03.169 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:03.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.315 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:28:03.350 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:03.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.350 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-08-17T02:28:03.425 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:28:03.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.427 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:03.427 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:03.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:03.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:28:03.427 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:03.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:28:03.607 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:03.607 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:03.607 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:03.607 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.607 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether e6:dc:f3:ef:a4:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::e4dc:f3ff:feef:a44e/64 scope link 2024-08-17T02:28:03.608 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.610 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:28:03.665 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether e6:dc:f3:ef:a4:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:03.666 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::e4dc:f3ff:feef:a44e/64 scope link 2024-08-17T02:28:03.667 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:03.668 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:28:03.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:28:03.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:28:03.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:28:03.670 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:03.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:03.836 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:03.836 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:03.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-08-17T02:28:03.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:28:03.836 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:03.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:03.951 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:03.986 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:28:03.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:03.986 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:04.061 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:28:04.061 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:04.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:04.184 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:04.184 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:04.210 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:04.210 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 3@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:04.211 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:04.214 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:04.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:04.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:04.270 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:28:04.285 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.448+0000 7f8b53800640 1 Processor -- start 2024-08-17T02:28:04.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.448+0000 7f8b53800640 1 -- start start 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b53800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b53800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b4c0ac820 0x7f8b4c159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b53800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0abc80 con 0x7f8b4c0aa910 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b53800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ab070 con 0x7f8b4c158cb0 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b53800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ab350 con 0x7f8b4c0ac820 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.449+0000 7f8b50e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60930/0 (socket says 172.21.15.46:60930) 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 -- 172.21.15.46:0/708995239 learned_addr learned my addr 172.21.15.46:0/708995239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b51800640 1 --2- 172.21.15.46:0/708995239 >> v2:172.21.15.162:3300/0 conn(0x7f8b4c0ac820 0x7f8b4c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 -- 172.21.15.46:0/708995239 >> v2:172.21.15.162:3300/0 conn(0x7f8b4c0ac820 msgr2=0x7f8b4c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 --2- 172.21.15.46:0/708995239 >> v2:172.21.15.162:3300/0 conn(0x7f8b4c0ac820 0x7f8b4c159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 -- 172.21.15.46:0/708995239 >> v1:172.21.15.162:6789/0 conn(0x7f8b4c0aa910 legacy=0x7f8b4c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b4b400640 1 -- 172.21.15.46:0/708995239 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093248204 0 0) 0x7f8b4c0abc80 con 0x7f8b4c0aa910 2024-08-17T02:28:04.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.450+0000 7f8b50e00640 1 -- 172.21.15.46:0/708995239 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0ab630 con 0x7f8b4c158cb0 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.451+0000 7f8b50e00640 1 --2- 172.21.15.46:0/708995239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c069fa0 tx=0x7f8b400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592ed96140c91cc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.451+0000 7f8b4b400640 1 -- 172.21.15.46:0/708995239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4002ae80 con 0x7f8b4c158cb0 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.451+0000 7f8b4b400640 1 -- 172.21.15.46:0/708995239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40032440 con 0x7f8b4c158cb0 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.451+0000 7f8b4b400640 1 -- 172.21.15.46:0/708995239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400327c0 con 0x7f8b4c158cb0 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 -- 172.21.15.46:0/708995239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c158cb0 msgr2=0x7f8b4c0af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 --2- 172.21.15.46:0/708995239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c069fa0 tx=0x7f8b400091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 -- 172.21.15.46:0/708995239 shutdown_connections 2024-08-17T02:28:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 --2- 172.21.15.46:0/708995239 >> v2:172.21.15.162:3300/0 conn(0x7f8b4c0ac820 0x7f8b4c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 --2- 172.21.15.46:0/708995239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c158cb0 0x7f8b4c0af6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 -- 172.21.15.46:0/708995239 >> 172.21.15.46:0/708995239 conn(0x7f8b4c096a70 msgr2=0x7f8b4c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 -- 172.21.15.46:0/708995239 shutdown_connections 2024-08-17T02:28:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.452+0000 7f8b53800640 1 -- 172.21.15.46:0/708995239 wait complete. 2024-08-17T02:28:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.453+0000 7f8b53800640 1 Processor -- start 2024-08-17T02:28:04.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 -- start start 2024-08-17T02:28:04.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4c0ac820 0x7f8b4c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b4c158cb0 0x7f8b4c169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c168fc0 con 0x7f8b4c0aa910 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c169580 con 0x7f8b4c0ac820 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.454+0000 7f8b53800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0ce9c0 con 0x7f8b4c158cb0 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60942/0 (socket says 172.21.15.46:60942) 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 -- 172.21.15.46:0/951950235 learned_addr learned my addr 172.21.15.46:0/951950235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b51800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b4c158cb0 0x7f8b4c169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b4be00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4c0ac820 0x7f8b4c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 -- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b4c158cb0 msgr2=0x7f8b4c169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b4c158cb0 0x7f8b4c169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 -- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4c0ac820 msgr2=0x7f8b4c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4c0ac820 0x7f8b4c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 -- 172.21.15.46:0/951950235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009450 con 0x7f8b4c0aa910 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.455+0000 7f8b50e00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009940 tx=0x7f8b40032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.456+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40031de0 con 0x7f8b4c0aa910 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.456+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40000c40 con 0x7f8b4c0aa910 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.456+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4003d670 con 0x7f8b4c0aa910 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.456+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c169f50 con 0x7f8b4c0aa910 2024-08-17T02:28:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.456+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c15b910 con 0x7f8b4c0aa910 2024-08-17T02:28:04.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.457+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c064db0 con 0x7f8b4c0aa910 2024-08-17T02:28:04.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.458+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b40039040 con 0x7f8b4c0aa910 2024-08-17T02:28:04.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.459+0000 7f8b3fe00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 0x7f8b2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.459+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b400a2620 con 0x7f8b4c0aa910 2024-08-17T02:28:04.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.459+0000 7f8b4be00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 0x7f8b2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.460+0000 7f8b4be00640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 0x7f8b2c067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c15dcf0 tx=0x7f8b38007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.463+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b400706f0 con 0x7f8b4c0aa910 2024-08-17T02:28:04.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.647+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b4c0ac600 con 0x7f8b4c0aa910 2024-08-17T02:28:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.647+0000 7f8b3fe00640 1 -- 172.21.15.46:0/951950235 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f8b40073d10 con 0x7f8b4c0aa910 2024-08-17T02:28:04.648 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:04.649 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:04.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 msgr2=0x7f8b2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 0x7f8b2c067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c15dcf0 tx=0x7f8b38007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 msgr2=0x7f8b4c09b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009940 tx=0x7f8b40032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 shutdown_connections 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8b2c065150 0x7f8b2c067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b4c158cb0 0x7f8b4c169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4c0ac820 0x7f8b4c0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.649+0000 7f8b53800640 1 --2- 172.21.15.46:0/951950235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8b4c0aa910 0x7f8b4c09b3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.650+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 >> 172.21.15.46:0/951950235 conn(0x7f8b4c096a70 msgr2=0x7f8b4c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.650+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 shutdown_connections 2024-08-17T02:28:04.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.650+0000 7f8b53800640 1 -- 172.21.15.46:0/951950235 wait complete. 2024-08-17T02:28:04.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:04.666 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.821+0000 7f5554600640 1 Processor -- start 2024-08-17T02:28:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.821+0000 7f5554600640 1 -- start start 2024-08-17T02:28:04.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c157e10 0x7f554c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0adcf0 0x7f554c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0b1390 con 0x7f554c157e10 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0ae130 con 0x7f554c0b0a80 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5554600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c157070 con 0x7f554c0adcf0 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5551200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c157e10 0x7f554c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5551c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5551200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f554c157e10 0x7f554c0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60944/0 (socket says 172.21.15.46:60944) 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5551200640 1 -- 172.21.15.46:0/1122648201 learned_addr learned my addr 172.21.15.46:0/1122648201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.822+0000 7f5551c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:40526/0 (socket says 172.21.15.46:40526) 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5552600640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0adcf0 0x7f554c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551200640 1 -- 172.21.15.46:0/1122648201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0adcf0 msgr2=0x7f554c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551200640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0adcf0 0x7f554c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551200640 1 -- 172.21.15.46:0/1122648201 >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 msgr2=0x7f554c0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551200640 1 --2- 172.21.15.46:0/1122648201 >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551200640 1 -- 172.21.15.46:0/1122648201 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c15b410 con 0x7f554c157e10 2024-08-17T02:28:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.823+0000 7f5551c00640 1 --2- 172.21.15.46:0/1122648201 >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.824+0000 7f5551200640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c157e10 0x7f554c0ad7b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f554c068410 tx=0x7f55380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a55af17755f068d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.824+0000 7f554be00640 1 -- 172.21.15.46:0/1122648201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553802ad40 con 0x7f554c157e10 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.824+0000 7f554be00640 1 -- 172.21.15.46:0/1122648201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538032440 con 0x7f554c157e10 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.824+0000 7f554be00640 1 -- 172.21.15.46:0/1122648201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553802aea0 con 0x7f554c157e10 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 -- 172.21.15.46:0/1122648201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c157e10 msgr2=0x7f554c0ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c157e10 0x7f554c0ad7b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f554c068410 tx=0x7f55380091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 -- 172.21.15.46:0/1122648201 shutdown_connections 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0adcf0 0x7f554c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 --2- 172.21.15.46:0/1122648201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c157e10 0x7f554c0ad7b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 --2- 172.21.15.46:0/1122648201 >> v2:172.21.15.162:3300/0 conn(0x7f554c0b0a80 0x7f554c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 -- 172.21.15.46:0/1122648201 >> 172.21.15.46:0/1122648201 conn(0x7f554c067750 msgr2=0x7f554c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 -- 172.21.15.46:0/1122648201 shutdown_connections 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.825+0000 7f5554600640 1 -- 172.21.15.46:0/1122648201 wait complete. 2024-08-17T02:28:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.826+0000 7f5554600640 1 Processor -- start 2024-08-17T02:28:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.827+0000 7f5554600640 1 -- start start 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.827+0000 7f5554600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5554600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0b0a80 0x7f554c16d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5554600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554c157e10 0x7f554c168fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5554600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c151480 con 0x7f554c0adcf0 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5554600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c14e4a0 con 0x7f554c157e10 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5554600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c16dd30 con 0x7f554c0b0a80 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60952/0 (socket says 172.21.15.46:60952) 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 -- 172.21.15.46:0/3925238319 learned_addr learned my addr 172.21.15.46:0/3925238319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551200640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0b0a80 0x7f554c16d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5552600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554c157e10 0x7f554c168fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 -- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0b0a80 msgr2=0x7f554c16d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0b0a80 0x7f554c16d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 -- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554c157e10 msgr2=0x7f554c168fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554c157e10 0x7f554c168fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.828+0000 7f5551c00640 1 -- 172.21.15.46:0/3925238319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009390 con 0x7f554c0adcf0 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5551c00640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f554000eaa0 tx=0x7f55400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000c9b0 con 0x7f554c0adcf0 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554000cb10 con 0x7f554c0adcf0 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000ce90 con 0x7f554c0adcf0 2024-08-17T02:28:04.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538009450 con 0x7f554c0adcf0 2024-08-17T02:28:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.829+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c150490 con 0x7f554c0adcf0 2024-08-17T02:28:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.830+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c0688c0 con 0x7f554c0adcf0 2024-08-17T02:28:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.831+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5540013680 con 0x7f554c0adcf0 2024-08-17T02:28:04.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.832+0000 7f5548c00640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 0x7f552c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.832+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5540082660 con 0x7f554c0adcf0 2024-08-17T02:28:04.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.832+0000 7f5551200640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 0x7f552c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.833+0000 7f5551200640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 0x7f552c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5538034000 tx=0x7f5538032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:04.836+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f554c0688c0 con 0x7f554c0adcf0 2024-08-17T02:28:05.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.020+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f554c0688c0 con 0x7f554c0adcf0 2024-08-17T02:28:05.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.020+0000 7f5548c00640 1 -- 172.21.15.46:0/3925238319 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f554c0688c0 con 0x7f554c0adcf0 2024-08-17T02:28:05.021 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:05.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 msgr2=0x7f552c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 0x7f552c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5538034000 tx=0x7f5538032000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 msgr2=0x7f554c14fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f554000eaa0 tx=0x7f55400090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 shutdown_connections 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f554c157e10 0x7f554c168fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f552c065150 0x7f552c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f554c0b0a80 0x7f554c16d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 --2- 172.21.15.46:0/3925238319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f554c0adcf0 0x7f554c14fd70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 >> 172.21.15.46:0/3925238319 conn(0x7f554c067750 msgr2=0x7f554c14cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 shutdown_connections 2024-08-17T02:28:05.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.022+0000 7f5554600640 1 -- 172.21.15.46:0/3925238319 wait complete. 2024-08-17T02:28:05.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.193+0000 7f3828e00640 1 Processor -- start 2024-08-17T02:28:05.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.193+0000 7f3828e00640 1 -- start start 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3824155a80 0x7f382406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 0x7f38240c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 0x7f38240c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38241598f0 con 0x7f3824155a80 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3824159bd0 con 0x7f38240c7db0 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3828e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824159eb0 con 0x7f3824155e50 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3821e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3824155a80 0x7f382406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3821e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3824155a80 0x7f382406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60954/0 (socket says 172.21.15.46:60954) 2024-08-17T02:28:05.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.194+0000 7f3821e00640 1 -- 172.21.15.46:0/1646309592 learned_addr learned my addr 172.21.15.46:0/1646309592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:05.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3822800640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 0x7f38240c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f381be00640 1 --2- 172.21.15.46:0/1646309592 >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 0x7f38240c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3821e00640 1 -- 172.21.15.46:0/1646309592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 msgr2=0x7f38240c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3821e00640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 0x7f38240c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3821e00640 1 -- 172.21.15.46:0/1646309592 >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 msgr2=0x7f38240c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3821e00640 1 --2- 172.21.15.46:0/1646309592 >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 0x7f38240c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3821e00640 1 -- 172.21.15.46:0/1646309592 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382415a190 con 0x7f3824155a80 2024-08-17T02:28:05.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f381be00640 1 --2- 172.21.15.46:0/1646309592 >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 0x7f38240c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:05.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.195+0000 7f3822800640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 0x7f38240c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:05.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.196+0000 7f3821e00640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155a80 0x7f382406dc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f382406c750 tx=0x7f38140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f633dcffb518b0ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.196+0000 7f3821400640 1 -- 172.21.15.46:0/1646309592 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381402ae60 con 0x7f3824155a80 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.196+0000 7f3821400640 1 -- 172.21.15.46:0/1646309592 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814032440 con 0x7f3824155a80 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.196+0000 7f3821400640 1 -- 172.21.15.46:0/1646309592 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140327e0 con 0x7f3824155a80 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 -- 172.21.15.46:0/1646309592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155a80 msgr2=0x7f382406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155a80 0x7f382406dc00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f382406c750 tx=0x7f38140091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 -- 172.21.15.46:0/1646309592 shutdown_connections 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3824155e50 0x7f38240c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 --2- 172.21.15.46:0/1646309592 >> v2:172.21.15.162:3300/0 conn(0x7f38240c7db0 0x7f38240c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 --2- 172.21.15.46:0/1646309592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155a80 0x7f382406dc00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 -- 172.21.15.46:0/1646309592 >> 172.21.15.46:0/1646309592 conn(0x7f3824067750 msgr2=0x7f38240c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 -- 172.21.15.46:0/1646309592 shutdown_connections 2024-08-17T02:28:05.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.197+0000 7f3828e00640 1 -- 172.21.15.46:0/1646309592 wait complete. 2024-08-17T02:28:05.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.198+0000 7f3828e00640 1 Processor -- start 2024-08-17T02:28:05.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.198+0000 7f3828e00640 1 -- start start 2024-08-17T02:28:05.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38240c7db0 0x7f38240c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3824155a80 0x7f382414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824152e70 con 0x7f3824155e50 2024-08-17T02:28:05.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c7760 con 0x7f3824155a80 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3828e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382414fdd0 con 0x7f38240c7db0 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3822800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3822800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60966/0 (socket says 172.21.15.46:60966) 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.199+0000 7f3822800640 1 -- 172.21.15.46:0/300391046 learned_addr learned my addr 172.21.15.46:0/300391046 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3821e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38240c7db0 0x7f38240c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f381be00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3824155a80 0x7f382414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 -- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38240c7db0 msgr2=0x7f38240c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38240c7db0 0x7f38240c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 -- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3824155a80 msgr2=0x7f382414f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3824155a80 0x7f382414f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 -- 172.21.15.46:0/300391046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814009450 con 0x7f3824155e50 2024-08-17T02:28:05.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3822800640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f381c00cef0 tx=0x7f381c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c016420 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c0165a0 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c016960 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.200+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3824152260 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.201+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824152820 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.202+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824071050 con 0x7f3824155e50 2024-08-17T02:28:05.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.202+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f381c00e3f0 con 0x7f3824155e50 2024-08-17T02:28:05.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.203+0000 7f3819600640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 0x7f3800067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.203+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f381c012070 con 0x7f3824155e50 2024-08-17T02:28:05.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.204+0000 7f3821e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 0x7f3800067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.204+0000 7f3821e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 0x7f3800067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3814034000 tx=0x7f3814032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.207+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f381c04ee40 con 0x7f3824155e50 2024-08-17T02:28:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.393+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f382406aa10 con 0x7f3824155e50 2024-08-17T02:28:05.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.394+0000 7f3819600640 1 -- 172.21.15.46:0/300391046 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f381c050ec0 con 0x7f3824155e50 2024-08-17T02:28:05.395 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.395+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 msgr2=0x7f3800067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.395+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 0x7f3800067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3814034000 tx=0x7f3814032000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 msgr2=0x7f38240a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f381c00cef0 tx=0x7f381c007860 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 shutdown_connections 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3824155e50 0x7f38240a98e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3824155a80 0x7f382414f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3800065150 0x7f3800067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 --2- 172.21.15.46:0/300391046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38240c7db0 0x7f38240c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 >> 172.21.15.46:0/300391046 conn(0x7f3824067750 msgr2=0x7f3824150110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 shutdown_connections 2024-08-17T02:28:05.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.396+0000 7f3828e00640 1 -- 172.21.15.46:0/300391046 wait complete. 2024-08-17T02:28:05.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.564+0000 7f8e3da00640 1 Processor -- start 2024-08-17T02:28:05.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.564+0000 7f8e3da00640 1 -- start start 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3da00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e380abef0 0x7f8e380accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e380ad210 0x7f8e3806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3da00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e38156e60 con 0x7f8e3806d930 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3da00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380c95e0 con 0x7f8e380abef0 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380ad660 con 0x7f8e380ad210 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e380abef0 0x7f8e380accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e380abef0 0x7f8e380accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60980/0 (socket says 172.21.15.46:60980) 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 -- 172.21.15.46:0/767941667 learned_addr learned my addr 172.21.15.46:0/767941667 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e3d000640 1 --1- 172.21.15.46:0/767941667 >> v1:172.21.15.46:6789/0 conn(0x7f8e3806d930 0x7f8e3815a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54190/0 (socket says 172.21.15.46:54190) 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e380ad210 0x7f8e3806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 -- 172.21.15.46:0/767941667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e380ad210 msgr2=0x7f8e3806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e380ad210 0x7f8e3806d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 -- 172.21.15.46:0/767941667 >> v1:172.21.15.46:6789/0 conn(0x7f8e3806d930 legacy=0x7f8e3815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.566+0000 7f8e37e00640 1 -- 172.21.15.46:0/767941667 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380ac2c0 con 0x7f8e380abef0 2024-08-17T02:28:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.567+0000 7f8e37e00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e380accd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009910 tx=0x7f8e280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c58cd8ac498c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e37400640 1 -- 172.21.15.46:0/767941667 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2802ae40 con 0x7f8e380abef0 2024-08-17T02:28:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e37400640 1 -- 172.21.15.46:0/767941667 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28032440 con 0x7f8e380abef0 2024-08-17T02:28:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e37400640 1 -- 172.21.15.46:0/767941667 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28032820 con 0x7f8e380abef0 2024-08-17T02:28:05.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 -- 172.21.15.46:0/767941667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 msgr2=0x7f8e380accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e380accd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009910 tx=0x7f8e280091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 -- 172.21.15.46:0/767941667 shutdown_connections 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e380ad210 0x7f8e3806d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 --2- 172.21.15.46:0/767941667 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e380accd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 -- 172.21.15.46:0/767941667 >> 172.21.15.46:0/767941667 conn(0x7f8e38066cd0 msgr2=0x7f8e380670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 -- 172.21.15.46:0/767941667 shutdown_connections 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.568+0000 7f8e3da00640 1 -- 172.21.15.46:0/767941667 wait complete. 2024-08-17T02:28:05.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.570+0000 7f8e3da00640 1 Processor -- start 2024-08-17T02:28:05.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.570+0000 7f8e3da00640 1 -- start start 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3806d930 0x7f8e381468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e380ad210 0x7f8e3806a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c7600 con 0x7f8e380abef0 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c6ce0 con 0x7f8e380ad210 2024-08-17T02:28:05.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380c60d0 con 0x7f8e3806d930 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60982/0 (socket says 172.21.15.46:60982) 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 -- 172.21.15.46:0/4075186796 learned_addr learned my addr 172.21.15.46:0/4075186796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e37e00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3806d930 0x7f8e381468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e3d000640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e380ad210 0x7f8e3806a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 -- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3806d930 msgr2=0x7f8e381468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3806d930 0x7f8e381468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 -- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e380ad210 msgr2=0x7f8e3806a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.571+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e380ad210 0x7f8e3806a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e2fe00640 1 -- 172.21.15.46:0/4075186796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009450 con 0x7f8e380abef0 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000d890 tx=0x7f8e20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000de20 con 0x7f8e380abef0 2024-08-17T02:28:05.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e200098b0 con 0x7f8e380abef0 2024-08-17T02:28:05.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20009c50 con 0x7f8e380abef0 2024-08-17T02:28:05.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e380c63b0 con 0x7f8e380abef0 2024-08-17T02:28:05.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.572+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380c6970 con 0x7f8e380abef0 2024-08-17T02:28:05.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.573+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e380c6e90 con 0x7f8e380abef0 2024-08-17T02:28:05.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.574+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e20014620 con 0x7f8e380abef0 2024-08-17T02:28:05.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.575+0000 7f8e2f400640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 0x7f8e14067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.575+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e20082bf0 con 0x7f8e380abef0 2024-08-17T02:28:05.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.575+0000 7f8e37e00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 0x7f8e14067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.576+0000 7f8e37e00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 0x7f8e14067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e28034000 tx=0x7f8e28032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.579+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e380c6e90 con 0x7f8e380abef0 2024-08-17T02:28:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.760+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e380c6e50 con 0x7f8e380abef0 2024-08-17T02:28:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.761+0000 7f8e2f400640 1 -- 172.21.15.46:0/4075186796 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e20050c10 con 0x7f8e380abef0 2024-08-17T02:28:05.762 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 msgr2=0x7f8e14067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 0x7f8e14067630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e28034000 tx=0x7f8e28032000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 msgr2=0x7f8e38069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000d890 tx=0x7f8e20008040 comp rx=0 tx=0).stop 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 shutdown_connections 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e380ad210 0x7f8e3806a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e380abef0 0x7f8e38069e00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e14065180 0x7f8e14067630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 --2- 172.21.15.46:0/4075186796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e3806d930 0x7f8e381468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 >> 172.21.15.46:0/4075186796 conn(0x7f8e38066cd0 msgr2=0x7f8e380cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 shutdown_connections 2024-08-17T02:28:05.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.763+0000 7f8e3da00640 1 -- 172.21.15.46:0/4075186796 wait complete. 2024-08-17T02:28:05.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:05.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.931+0000 7fcba3e00640 1 Processor -- start 2024-08-17T02:28:05.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.931+0000 7fcba3e00640 1 -- start start 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcba40ccad0 0x7fcba4162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba3e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40cadc0 con 0x7fcba4159ca0 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba3e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba40cd6e0 con 0x7fcba40ccad0 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ccf70 con 0x7fcba40ceb40 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.932+0000 7fcba2a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcba4159ca0 0x7fcba40ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54206/0 (socket says 172.21.15.46:54206) 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba2a00640 1 -- 172.21.15.46:0/4224103630 learned_addr learned my addr 172.21.15.46:0/4224103630 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba3400640 1 --2- 172.21.15.46:0/4224103630 >> v2:172.21.15.46:3300/0 conn(0x7fcba40ccad0 0x7fcba4162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba2000640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba1600640 1 -- 172.21.15.46:0/4224103630 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301095638 0 0) 0x7fcba40cadc0 con 0x7fcba4159ca0 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba1600640 1 -- 172.21.15.46:0/4224103630 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb880034e0 con 0x7fcba4159ca0 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba3400640 1 -- 172.21.15.46:0/4224103630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 msgr2=0x7fcba40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba3400640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba3400640 1 -- 172.21.15.46:0/4224103630 >> v1:172.21.15.46:6789/0 conn(0x7fcba4159ca0 legacy=0x7fcba40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.933+0000 7fcba3400640 1 -- 172.21.15.46:0/4224103630 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40cb060 con 0x7fcba40ccad0 2024-08-17T02:28:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.934+0000 7fcba3400640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba4162860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e60 tx=0x7fcb9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a22b66e519b080 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.934+0000 7fcba1600640 1 -- 172.21.15.46:0/4224103630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c007550 con 0x7fcba40ccad0 2024-08-17T02:28:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.934+0000 7fcba1600640 1 -- 172.21.15.46:0/4224103630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c02d050 con 0x7fcba40ccad0 2024-08-17T02:28:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.934+0000 7fcba1600640 1 -- 172.21.15.46:0/4224103630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c007920 con 0x7fcba40ccad0 2024-08-17T02:28:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 -- 172.21.15.46:0/4224103630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 msgr2=0x7fcba4162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba4162860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009e60 tx=0x7fcb9c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 -- 172.21.15.46:0/4224103630 shutdown_connections 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba4162860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 --2- 172.21.15.46:0/4224103630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 -- 172.21.15.46:0/4224103630 >> 172.21.15.46:0/4224103630 conn(0x7fcba4098e00 msgr2=0x7fcba406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 -- 172.21.15.46:0/4224103630 shutdown_connections 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.935+0000 7fcba3e00640 1 -- 172.21.15.46:0/4224103630 wait complete. 2024-08-17T02:28:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.937+0000 7fcba3e00640 1 Processor -- start 2024-08-17T02:28:05.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.937+0000 7fcba3e00640 1 -- start start 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba4159ca0 0x7fcba41694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4169a10 con 0x7fcba40ccad0 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c9230 con 0x7fcba4159ca0 2024-08-17T02:28:05.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c8620 con 0x7fcba40ceb40 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32770/0 (socket says 172.21.15.46:32770) 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 -- 172.21.15.46:0/518991540 learned_addr learned my addr 172.21.15.46:0/518991540 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2000640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba3400640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba4159ca0 0x7fcba41694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 -- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 msgr2=0x7fcba4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba4158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 -- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba4159ca0 msgr2=0x7fcba41694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.938+0000 7fcba2a00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba4159ca0 0x7fcba41694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcba2a00640 1 -- 172.21.15.46:0/518991540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009a20 con 0x7fcba40ccad0 2024-08-17T02:28:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcba2a00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c590 tx=0x7fcb94007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94005b70 con 0x7fcba40ccad0 2024-08-17T02:28:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb94005cf0 con 0x7fcba40ccad0 2024-08-17T02:28:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007320 con 0x7fcba40ccad0 2024-08-17T02:28:05.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40c8900 con 0x7fcba40ccad0 2024-08-17T02:28:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.939+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba40c8ec0 con 0x7fcba40ccad0 2024-08-17T02:28:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.940+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba4071050 con 0x7fcba40ccad0 2024-08-17T02:28:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.941+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb94012400 con 0x7fcba40ccad0 2024-08-17T02:28:05.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.942+0000 7fcb9a000640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 0x7fcb84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.942+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb940818e0 con 0x7fcba40ccad0 2024-08-17T02:28:05.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.942+0000 7fcba2000640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 0x7fcb84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.943+0000 7fcba2000640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 0x7fcb84067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c6610 tx=0x7fcb900090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:05.946+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb9404fa50 con 0x7fcba40ccad0 2024-08-17T02:28:06.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.128+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba4067730 con 0x7fcba40ccad0 2024-08-17T02:28:06.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.129+0000 7fcb9a000640 1 -- 172.21.15.46:0/518991540 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcb94053070 con 0x7fcba40ccad0 2024-08-17T02:28:06.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:06.130 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 msgr2=0x7fcb84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 0x7fcb84067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcba40c6610 tx=0x7fcb900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 msgr2=0x7fcba40c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c590 tx=0x7fcb94007d70 comp rx=0 tx=0).stop 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 shutdown_connections 2024-08-17T02:28:06.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcba4159ca0 0x7fcba41694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcb84065150 0x7fcb84067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcba40ceb40 0x7fcba4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 --2- 172.21.15.46:0/518991540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcba40ccad0 0x7fcba40c96c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 >> 172.21.15.46:0/518991540 conn(0x7fcba4098e00 msgr2=0x7fcba40d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 shutdown_connections 2024-08-17T02:28:06.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.131+0000 7fcba3e00640 1 -- 172.21.15.46:0/518991540 wait complete. 2024-08-17T02:28:06.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:06.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.300+0000 7f3e57200640 1 Processor -- start 2024-08-17T02:28:06.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.300+0000 7f3e57200640 1 -- start start 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e500accf0 0x7f3e500b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3e50159610 0x7f3e500af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500b0020 con 0x7f3e500accf0 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500ae540 con 0x7f3e50159610 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.301+0000 7f3e57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500ad930 con 0x7f3e500afbc0 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e500accf0 0x7f3e500b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3e500accf0 0x7f3e500b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32784/0 (socket says 172.21.15.46:32784) 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 -- 172.21.15.46:0/103526858 learned_addr learned my addr 172.21.15.46:0/103526858 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e55200640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e47e00640 1 --2- 172.21.15.46:0/103526858 >> v2:172.21.15.162:3300/0 conn(0x7f3e50159610 0x7f3e500af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 -- 172.21.15.46:0/103526858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 msgr2=0x7f3e50156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 -- 172.21.15.46:0/103526858 >> v2:172.21.15.162:3300/0 conn(0x7f3e50159610 msgr2=0x7f3e500af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/103526858 >> v2:172.21.15.162:3300/0 conn(0x7f3e50159610 0x7f3e500af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.302+0000 7f3e4fe00640 1 -- 172.21.15.46:0/103526858 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500adc10 con 0x7f3e500accf0 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.303+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e500accf0 0x7f3e500b1670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e500b1bb0 tx=0x7f3e400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7a5c6064a4c444 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.303+0000 7f3e4f400640 1 -- 172.21.15.46:0/103526858 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40031510 con 0x7f3e500accf0 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.303+0000 7f3e4f400640 1 -- 172.21.15.46:0/103526858 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4002f050 con 0x7f3e500accf0 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.303+0000 7f3e4f400640 1 -- 172.21.15.46:0/103526858 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400318e0 con 0x7f3e500accf0 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 -- 172.21.15.46:0/103526858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e500accf0 msgr2=0x7f3e500b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e500accf0 0x7f3e500b1670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3e500b1bb0 tx=0x7f3e400091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 -- 172.21.15.46:0/103526858 shutdown_connections 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 --2- 172.21.15.46:0/103526858 >> v2:172.21.15.162:3300/0 conn(0x7f3e50159610 0x7f3e500af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 --2- 172.21.15.46:0/103526858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e500accf0 0x7f3e500b1670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 -- 172.21.15.46:0/103526858 >> 172.21.15.46:0/103526858 conn(0x7f3e50067750 msgr2=0x7f3e500cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 -- 172.21.15.46:0/103526858 shutdown_connections 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.304+0000 7f3e57200640 1 -- 172.21.15.46:0/103526858 wait complete. 2024-08-17T02:28:06.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.305+0000 7f3e57200640 1 Processor -- start 2024-08-17T02:28:06.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 -- start start 2024-08-17T02:28:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e500accf0 0x7f3e5013da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5015acf0 con 0x7f3e50159610 2024-08-17T02:28:06.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5013df40 con 0x7f3e500accf0 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.306+0000 7f3e57200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e50159e00 con 0x7f3e500afbc0 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32790/0 (socket says 172.21.15.46:32790) 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 -- 172.21.15.46:0/3880394627 learned_addr learned my addr 172.21.15.46:0/3880394627 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e47e00640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e500accf0 0x7f3e5013da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 -- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 msgr2=0x7f3e50153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 -- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e500accf0 msgr2=0x7f3e5013da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e500accf0 0x7f3e5013da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e55200640 1 -- 172.21.15.46:0/3880394627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009450 con 0x7f3e50159610 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.307+0000 7f3e47e00640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e55200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009fa0 tx=0x7f3e48009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ee60 con 0x7f3e50159610 2024-08-17T02:28:06.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48014420 con 0x7f3e50159610 2024-08-17T02:28:06.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480147e0 con 0x7f3e50159610 2024-08-17T02:28:06.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5015a0e0 con 0x7f3e50159610 2024-08-17T02:28:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.308+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5015a6a0 con 0x7f3e50159610 2024-08-17T02:28:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.309+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e50064db0 con 0x7f3e50159610 2024-08-17T02:28:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.310+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3e48014b50 con 0x7f3e50159610 2024-08-17T02:28:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.311+0000 7f3e47400640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 0x7f3e2c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.311+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e48082cc0 con 0x7f3e50159610 2024-08-17T02:28:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.311+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 0x7f3e2c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.312+0000 7f3e4fe00640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 0x7f3e2c067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e40036000 tx=0x7f3e40037000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.315+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3e48089080 con 0x7f3e50159610 2024-08-17T02:28:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.497+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e50155a30 con 0x7f3e50159610 2024-08-17T02:28:06.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.498+0000 7f3e47400640 1 -- 172.21.15.46:0/3880394627 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e48050ce0 con 0x7f3e50159610 2024-08-17T02:28:06.499 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 msgr2=0x7f3e2c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 0x7f3e2c067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e40036000 tx=0x7f3e40037000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 msgr2=0x7f3e5015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009fa0 tx=0x7f3e48009900 comp rx=0 tx=0).stop 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 shutdown_connections 2024-08-17T02:28:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e50159610 0x7f3e5015c7c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3e2c065180 0x7f3e2c067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e500afbc0 0x7f3e50153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 --2- 172.21.15.46:0/3880394627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e500accf0 0x7f3e5013da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 >> 172.21.15.46:0/3880394627 conn(0x7f3e50067750 msgr2=0x7f3e50158630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 shutdown_connections 2024-08-17T02:28:06.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.500+0000 7f3e57200640 1 -- 172.21.15.46:0/3880394627 wait complete. 2024-08-17T02:28:06.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:06.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.671+0000 7fd0ae000640 1 Processor -- start 2024-08-17T02:28:06.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.671+0000 7fd0ae000640 1 -- start start 2024-08-17T02:28:06.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0ae000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd0a8155a80 0x7fd0a806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0ae000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 0x7fd0a80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0ae000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a81598f0 con 0x7fd0a80c7db0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0ae000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a8159bd0 con 0x7fd0a8155a80 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0ae000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8159eb0 con 0x7fd0a80c92e0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd09ea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd0a80c7db0 0x7fd0a80c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54210/0 (socket says 172.21.15.46:54210) 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd09ea00640 1 -- 172.21.15.46:0/536291553 learned_addr learned my addr 172.21.15.46:0/536291553 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0a7400640 1 --2- 172.21.15.46:0/536291553 >> v2:172.21.15.162:3300/0 conn(0x7fd0a8155a80 0x7fd0a806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.672+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/536291553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 0x7fd0a80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a6a00640 1 -- 172.21.15.46:0/536291553 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194633195 0 0) 0x7fd0a81598f0 con 0x7fd0a80c7db0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a6a00640 1 -- 172.21.15.46:0/536291553 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0034e0 con 0x7fd0a80c7db0 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a7e00640 1 -- 172.21.15.46:0/536291553 >> v2:172.21.15.162:3300/0 conn(0x7fd0a8155a80 msgr2=0x7fd0a806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/536291553 >> v2:172.21.15.162:3300/0 conn(0x7fd0a8155a80 0x7fd0a806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a7e00640 1 -- 172.21.15.46:0/536291553 >> v1:172.21.15.46:6789/0 conn(0x7fd0a80c7db0 legacy=0x7fd0a80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.673+0000 7fd0a7e00640 1 -- 172.21.15.46:0/536291553 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a815a190 con 0x7fd0a80c92e0 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.674+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/536291553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 0x7fd0a80aea40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e60 tx=0x7fd0a0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d39b0f3b83bcb3a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.674+0000 7fd0a6a00640 1 -- 172.21.15.46:0/536291553 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0007550 con 0x7fd0a80c92e0 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.674+0000 7fd0a6a00640 1 -- 172.21.15.46:0/536291553 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a002d050 con 0x7fd0a80c92e0 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.674+0000 7fd0a6a00640 1 -- 172.21.15.46:0/536291553 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00078c0 con 0x7fd0a80c92e0 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 -- 172.21.15.46:0/536291553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 msgr2=0x7fd0a80aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 --2- 172.21.15.46:0/536291553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 0x7fd0a80aea40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e60 tx=0x7fd0a0009780 comp rx=0 tx=0).stop 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 -- 172.21.15.46:0/536291553 shutdown_connections 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 --2- 172.21.15.46:0/536291553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c92e0 0x7fd0a80aea40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 --2- 172.21.15.46:0/536291553 >> v2:172.21.15.162:3300/0 conn(0x7fd0a8155a80 0x7fd0a806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 -- 172.21.15.46:0/536291553 >> 172.21.15.46:0/536291553 conn(0x7fd0a8067750 msgr2=0x7fd0a80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 -- 172.21.15.46:0/536291553 shutdown_connections 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.675+0000 7fd0ae000640 1 -- 172.21.15.46:0/536291553 wait complete. 2024-08-17T02:28:06.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.676+0000 7fd0ae000640 1 Processor -- start 2024-08-17T02:28:06.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 -- start start 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c7db0 0x7fd0a80adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 0x7fd0a8069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a81573d0 con 0x7fd0a8155a80 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8156330 con 0x7fd0a80c92e0 2024-08-17T02:28:06.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.677+0000 7fd0ae000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8156610 con 0x7fd0a80c7db0 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32796/0 (socket says 172.21.15.46:32796) 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 -- 172.21.15.46:0/739565022 learned_addr learned my addr 172.21.15.46:0/739565022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7400640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c7db0 0x7fd0a80adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd09ea00640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 0x7fd0a8069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 -- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c7db0 msgr2=0x7fd0a80adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c7db0 0x7fd0a80adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 -- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 msgr2=0x7fd0a8069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 0x7fd0a8069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 -- 172.21.15.46:0/739565022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a0009a20 con 0x7fd0a8155a80 2024-08-17T02:28:06.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd09ea00640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 0x7fd0a8069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.678+0000 7fd0a7e00640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00097c0 tx=0x7fd0a0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.679+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0031ac0 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.679+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0031c40 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.679+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a003d430 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.679+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a81568f0 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.679+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a8156eb0 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.680+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a81570d0 con 0x7fd0a8155a80 2024-08-17T02:28:06.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.681+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd0a0003040 con 0x7fd0a8155a80 2024-08-17T02:28:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.682+0000 7fd09f400640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 0x7fd084067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.682+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd0a00a3b80 con 0x7fd0a8155a80 2024-08-17T02:28:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.682+0000 7fd0a7400640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 0x7fd084067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.683+0000 7fd0a7400640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 0x7fd084067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd098009c80 tx=0x7fd0980090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.686+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd0a0071c50 con 0x7fd0a8155a80 2024-08-17T02:28:06.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.870+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0a8071050 con 0x7fd0a8155a80 2024-08-17T02:28:06.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.871+0000 7fd09f400640 1 -- 172.21.15.46:0/739565022 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0a0075270 con 0x7fd0a8155a80 2024-08-17T02:28:06.872 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:06.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 msgr2=0x7fd084067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 0x7fd084067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd098009c80 tx=0x7fd0980090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 msgr2=0x7fd0a8147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00097c0 tx=0x7fd0a0037000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 shutdown_connections 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a8155a80 0x7fd0a8147ef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0a80c92e0 0x7fd0a8069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd084065150 0x7fd084067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 --2- 172.21.15.46:0/739565022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0a80c7db0 0x7fd0a80adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 >> 172.21.15.46:0/739565022 conn(0x7fd0a8067750 msgr2=0x7fd0a80afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 shutdown_connections 2024-08-17T02:28:06.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:06.873+0000 7fd0ae000640 1 -- 172.21.15.46:0/739565022 wait complete. 2024-08-17T02:28:06.889 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:07.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.043+0000 7f686b000640 1 Processor -- start 2024-08-17T02:28:07.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.043+0000 7f686b000640 1 -- start start 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f686b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6864156c50 0x7f68640c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f686b000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68640adcf0 0x7f68640ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f686b000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68640ab130 con 0x7f68640abb00 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f686b000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640ae5a0 con 0x7f68640adcf0 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f686b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640ae2c0 con 0x7f6864156c50 2024-08-17T02:28:07.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f6863400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68640adcf0 0x7f68640ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f6863400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f68640adcf0 0x7f68640ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32804/0 (socket says 172.21.15.46:32804) 2024-08-17T02:28:07.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f6863400640 1 -- 172.21.15.46:0/85391060 learned_addr learned my addr 172.21.15.46:0/85391060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f6869000640 1 --1- 172.21.15.46:0/85391060 >> v1:172.21.15.46:6789/0 conn(0x7f68640abb00 0x7f68640c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54222/0 (socket says 172.21.15.46:54222) 2024-08-17T02:28:07.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.044+0000 7f6863e00640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6864156c50 0x7f68640c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.045+0000 7f6863400640 1 -- 172.21.15.46:0/85391060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6864156c50 msgr2=0x7f68640c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.045+0000 7f6863400640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6864156c50 0x7f68640c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.045+0000 7f6863400640 1 -- 172.21.15.46:0/85391060 >> v1:172.21.15.46:6789/0 conn(0x7f68640abb00 legacy=0x7f68640c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.045+0000 7f6863400640 1 -- 172.21.15.46:0/85391060 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640aaae0 con 0x7f68640adcf0 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.046+0000 7f6863400640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68640adcf0 0x7f68640ab5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6850009910 tx=0x7f68500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e53cbd4a5895885 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.046+0000 7f6862a00640 1 -- 172.21.15.46:0/85391060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685002add0 con 0x7f68640adcf0 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.046+0000 7f6862a00640 1 -- 172.21.15.46:0/85391060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850032440 con 0x7f68640adcf0 2024-08-17T02:28:07.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.046+0000 7f6862a00640 1 -- 172.21.15.46:0/85391060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850032820 con 0x7f68640adcf0 2024-08-17T02:28:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 -- 172.21.15.46:0/85391060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68640adcf0 msgr2=0x7f68640ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68640adcf0 0x7f68640ab5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6850009910 tx=0x7f68500091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 -- 172.21.15.46:0/85391060 shutdown_connections 2024-08-17T02:28:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f68640adcf0 0x7f68640ab5c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 --2- 172.21.15.46:0/85391060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6864156c50 0x7f68640c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 -- 172.21.15.46:0/85391060 >> 172.21.15.46:0/85391060 conn(0x7f6864067750 msgr2=0x7f68640c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 -- 172.21.15.46:0/85391060 shutdown_connections 2024-08-17T02:28:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.047+0000 7f686b000640 1 -- 172.21.15.46:0/85391060 wait complete. 2024-08-17T02:28:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.048+0000 7f686b000640 1 Processor -- start 2024-08-17T02:28:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.048+0000 7f686b000640 1 -- start start 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640abb00 0x7f686414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68640adcf0 0x7f6864154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641504a0 con 0x7f6864156c50 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641582f0 con 0x7f68640abb00 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.049+0000 7f686b000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68641585d0 con 0x7f68640adcf0 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32808/0 (socket says 172.21.15.46:32808) 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 -- 172.21.15.46:0/1295850720 learned_addr learned my addr 172.21.15.46:0/1295850720 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6863400640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68640adcf0 0x7f6864154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6863e00640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640abb00 0x7f686414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 -- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68640adcf0 msgr2=0x7f6864154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68640adcf0 0x7f6864154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 -- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640abb00 msgr2=0x7f686414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640abb00 0x7f686414ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.050+0000 7f6869000640 1 -- 172.21.15.46:0/1295850720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009450 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f6869000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c860 tx=0x7f685c001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00ce50 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c005d60 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00a890 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68641588b0 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.051+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686415f730 con 0x7f6864156c50 2024-08-17T02:28:07.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.052+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864158130 con 0x7f6864156c50 2024-08-17T02:28:07.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.053+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f685c00acc0 con 0x7f6864156c50 2024-08-17T02:28:07.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.054+0000 7f685b400640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 0x7f6844067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.054+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f685c0820a0 con 0x7f6864156c50 2024-08-17T02:28:07.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.054+0000 7f6863e00640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 0x7f6844067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.055+0000 7f6863e00640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 0x7f6844067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68640a9f30 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.058+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f685c0501f0 con 0x7f6864156c50 2024-08-17T02:28:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.242+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6864071050 con 0x7f6864156c50 2024-08-17T02:28:07.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.242+0000 7f685b400640 1 -- 172.21.15.46:0/1295850720 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f685c053810 con 0x7f6864156c50 2024-08-17T02:28:07.244 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 msgr2=0x7f6844067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 0x7f6844067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68640a9f30 tx=0x7f6854008040 comp rx=0 tx=0).stop 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 msgr2=0x7f6864155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c860 tx=0x7f685c001660 comp rx=0 tx=0).stop 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 shutdown_connections 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6864156c50 0x7f6864155510 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6844065150 0x7f6844067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68640adcf0 0x7f6864154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 --2- 172.21.15.46:0/1295850720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640abb00 0x7f686414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 >> 172.21.15.46:0/1295850720 conn(0x7f6864067750 msgr2=0x7f68640ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 shutdown_connections 2024-08-17T02:28:07.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.245+0000 7f686b000640 1 -- 172.21.15.46:0/1295850720 wait complete. 2024-08-17T02:28:07.260 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.413+0000 7fa5e9e00640 1 Processor -- start 2024-08-17T02:28:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.413+0000 7fa5e9e00640 1 -- start start 2024-08-17T02:28:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 0x7fa5e40ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40ce6d0 0x7fa5e40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa5e40cacf0 0x7fa5e40c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40cc890 con 0x7fa5e40cacf0 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40ceb20 con 0x7fa5e40aed50 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40cb4c0 con 0x7fa5e40ce6d0 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa5e40cacf0 0x7fa5e40c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa5e40cacf0 0x7fa5e40c4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32820/0 (socket says 172.21.15.46:32820) 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e9400640 1 -- 172.21.15.46:0/2444737732 learned_addr learned my addr 172.21.15.46:0/2444737732 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e3e00640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40ce6d0 0x7fa5e40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.414+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/2444737732 >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 0x7fa5e40ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e9400640 1 -- 172.21.15.46:0/2444737732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40ce6d0 msgr2=0x7fa5e40ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e9400640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40ce6d0 0x7fa5e40ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e9400640 1 -- 172.21.15.46:0/2444737732 >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 msgr2=0x7fa5e40ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e9400640 1 --2- 172.21.15.46:0/2444737732 >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 0x7fa5e40ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e9400640 1 -- 172.21.15.46:0/2444737732 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40cb7a0 con 0x7fa5e40cacf0 2024-08-17T02:28:07.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.415+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/2444737732 >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 0x7fa5e40ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e9400640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e40c4c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4088b90 tx=0x7fa5dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc06772c291884e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e3400640 1 -- 172.21.15.46:0/2444737732 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc031400 con 0x7fa5e40cacf0 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e3400640 1 -- 172.21.15.46:0/2444737732 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc02d050 con 0x7fa5e40cacf0 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e3400640 1 -- 172.21.15.46:0/2444737732 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0317d0 con 0x7fa5e40cacf0 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e9e00640 1 -- 172.21.15.46:0/2444737732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 msgr2=0x7fa5e40c4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.416+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e40c4c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4088b90 tx=0x7fa5dc009840 comp rx=0 tx=0).stop 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 -- 172.21.15.46:0/2444737732 shutdown_connections 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e40c4c30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/2444737732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40ce6d0 0x7fa5e40ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/2444737732 >> v2:172.21.15.162:3300/0 conn(0x7fa5e40aed50 0x7fa5e40ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 -- 172.21.15.46:0/2444737732 >> 172.21.15.46:0/2444737732 conn(0x7fa5e4098e30 msgr2=0x7fa5e406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 -- 172.21.15.46:0/2444737732 shutdown_connections 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.417+0000 7fa5e9e00640 1 -- 172.21.15.46:0/2444737732 wait complete. 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.418+0000 7fa5e9e00640 1 Processor -- start 2024-08-17T02:28:07.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.418+0000 7fa5e9e00640 1 -- start start 2024-08-17T02:28:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 0x7fa5e40b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e4068310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5e40ce6d0 0x7fa5e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4150fb0 con 0x7fa5e40cacf0 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b4490 con 0x7fa5e40ce6d0 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e9e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b3880 con 0x7fa5e40aed50 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e4068310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e4068310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32834/0 (socket says 172.21.15.46:32834) 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e3e00640 1 -- 172.21.15.46:0/721844345 learned_addr learned my addr 172.21.15.46:0/721844345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.419+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 0x7fa5e40b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e9400640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5e40ce6d0 0x7fa5e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 -- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5e40ce6d0 msgr2=0x7fa5e4068850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5e40ce6d0 0x7fa5e4068850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 -- 172.21.15.46:0/721844345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 msgr2=0x7fa5e4068310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e4068310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 -- 172.21.15.46:0/721844345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009ae0 con 0x7fa5e40aed50 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5e8a00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 0x7fa5e40b0f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d890 tx=0x7fa5d8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.420+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800de20 con 0x7fa5e40aed50 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.421+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d80098b0 con 0x7fa5e40aed50 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.421+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e40b3b60 con 0x7fa5e40aed50 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.421+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8009c50 con 0x7fa5e40aed50 2024-08-17T02:28:07.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.421+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e40b4120 con 0x7fa5e40aed50 2024-08-17T02:28:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.422+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4071050 con 0x7fa5e40aed50 2024-08-17T02:28:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.423+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa5d8014620 con 0x7fa5e40aed50 2024-08-17T02:28:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.423+0000 7fa5d7e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 0x7fa5c4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.423+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5d80829a0 con 0x7fa5e40aed50 2024-08-17T02:28:07.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.424+0000 7fa5e3e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 0x7fa5c4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.424+0000 7fa5e3e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 0x7fa5c4067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4154670 tx=0x7fa5d00090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.428+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa5d8050a70 con 0x7fa5e40aed50 2024-08-17T02:28:07.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.614+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5e4158c60 con 0x7fa5e40aed50 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.615+0000 7fa5d7e00640 1 -- 172.21.15.46:0/721844345 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa5d8054090 con 0x7fa5e40aed50 2024-08-17T02:28:07.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:07.617 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 msgr2=0x7fa5c4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 0x7fa5c4067630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4154670 tx=0x7fa5d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 msgr2=0x7fa5e40b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 0x7fa5e40b0f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d890 tx=0x7fa5d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 shutdown_connections 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5e40ce6d0 0x7fa5e4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa5e40cacf0 0x7fa5e4068310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa5c4065180 0x7fa5c4067630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 --2- 172.21.15.46:0/721844345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5e40aed50 0x7fa5e40b0f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 >> 172.21.15.46:0/721844345 conn(0x7fa5e4098e30 msgr2=0x7fa5e41581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 shutdown_connections 2024-08-17T02:28:07.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.618+0000 7fa5e9e00640 1 -- 172.21.15.46:0/721844345 wait complete. 2024-08-17T02:28:07.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:07.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.786+0000 7fdc1ea00640 1 Processor -- start 2024-08-17T02:28:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.786+0000 7fdc1ea00640 1 -- start start 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc180cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc180ce790 0x7fdc180b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180ceeb0 con 0x7fdc180cc700 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1ea00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180cf190 con 0x7fdc180ce790 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180cf470 con 0x7fdc18158e50 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc180ce790 0x7fdc180b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1e000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdc180ce790 0x7fdc180b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32844/0 (socket says 172.21.15.46:32844) 2024-08-17T02:28:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.787+0000 7fdc1e000640 1 -- 172.21.15.46:0/1631781265 learned_addr learned my addr 172.21.15.46:0/1631781265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1d600640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc180cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1e000640 1 -- 172.21.15.46:0/1631781265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 msgr2=0x7fdc180cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1e000640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc180cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1e000640 1 -- 172.21.15.46:0/1631781265 >> v1:172.21.15.162:6789/0 conn(0x7fdc180cc700 legacy=0x7fdc180ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1e000640 1 -- 172.21.15.46:0/1631781265 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180b2a00 con 0x7fdc180ce790 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.788+0000 7fdc1d600640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc180cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc1e000640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180ce790 0x7fdc180b3200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f20 tx=0x7fdc10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2324360bb05e79c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc17e00640 1 -- 172.21.15.46:0/1631781265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10031400 con 0x7fdc180ce790 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc17e00640 1 -- 172.21.15.46:0/1631781265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1002d050 con 0x7fdc180ce790 2024-08-17T02:28:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc17e00640 1 -- 172.21.15.46:0/1631781265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100317d0 con 0x7fdc180ce790 2024-08-17T02:28:07.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc1ea00640 1 -- 172.21.15.46:0/1631781265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180ce790 msgr2=0x7fdc180b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.789+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180ce790 0x7fdc180b3200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f20 tx=0x7fdc10009840 comp rx=0 tx=0).stop 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 -- 172.21.15.46:0/1631781265 shutdown_connections 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180ce790 0x7fdc180b3200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/1631781265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc180cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 -- 172.21.15.46:0/1631781265 >> 172.21.15.46:0/1631781265 conn(0x7fdc18098de0 msgr2=0x7fdc1806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 -- 172.21.15.46:0/1631781265 shutdown_connections 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.790+0000 7fdc1ea00640 1 -- 172.21.15.46:0/1631781265 wait complete. 2024-08-17T02:28:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.791+0000 7fdc1ea00640 1 Processor -- start 2024-08-17T02:28:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.791+0000 7fdc1ea00640 1 -- start start 2024-08-17T02:28:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc180ce790 0x7fdc180c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc1809ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809d3b0 con 0x7fdc180cc700 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180c5420 con 0x7fdc180ce790 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1ea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc180c5700 con 0x7fdc18158e50 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1d600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1d600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32856/0 (socket says 172.21.15.46:32856) 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.792+0000 7fdc1d600640 1 -- 172.21.15.46:0/4205872420 learned_addr learned my addr 172.21.15.46:0/4205872420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1e000640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc1809ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1cc00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc180ce790 0x7fdc180c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 -- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 msgr2=0x7fdc1809ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc1809ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 -- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc180ce790 msgr2=0x7fdc180c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc180ce790 0x7fdc180c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 -- 172.21.15.46:0/4205872420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10009ae0 con 0x7fdc180cc700 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1d600640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c880 tx=0x7fdc0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00ce10 con 0x7fdc180cc700 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c007830 con 0x7fdc180cc700 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c007c10 con 0x7fdc180cc700 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.793+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc180c59e0 con 0x7fdc180cc700 2024-08-17T02:28:07.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.794+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc181576c0 con 0x7fdc180cc700 2024-08-17T02:28:07.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.794+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc18071050 con 0x7fdc180cc700 2024-08-17T02:28:07.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.795+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdc0c011600 con 0x7fdc180cc700 2024-08-17T02:28:07.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.796+0000 7fdc14c00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 0x7fdbf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:07.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.796+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc0c082860 con 0x7fdc180cc700 2024-08-17T02:28:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.797+0000 7fdc1cc00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 0x7fdbf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.797+0000 7fdc1cc00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 0x7fdbf8067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc18159360 tx=0x7fdc04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:07.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.800+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdc0c050880 con 0x7fdc180cc700 2024-08-17T02:28:07.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.983+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc18064610 con 0x7fdc180cc700 2024-08-17T02:28:07.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.984+0000 7fdc14c00640 1 -- 172.21.15.46:0/4205872420 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc0c015020 con 0x7fdc180cc700 2024-08-17T02:28:07.984 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 msgr2=0x7fdbf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 0x7fdbf8067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdc18159360 tx=0x7fdc04009040 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 msgr2=0x7fdc18157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00c880 tx=0x7fdc0c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 shutdown_connections 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdbf8065150 0x7fdbf8067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc18158e50 0x7fdc1809ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc180ce790 0x7fdc180c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 --2- 172.21.15.46:0/4205872420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180cc700 0x7fdc18157fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 >> 172.21.15.46:0/4205872420 conn(0x7fdc18098de0 msgr2=0x7fdc180cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 shutdown_connections 2024-08-17T02:28:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:07.986+0000 7fdc1ea00640 1 -- 172.21.15.46:0/4205872420 wait complete. 2024-08-17T02:28:08.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.154+0000 7f3089400640 1 Processor -- start 2024-08-17T02:28:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.155+0000 7f3089400640 1 -- start start 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3089400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f308415c3e0 0x7f30840ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3089400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3084068560 con 0x7f3084068140 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3089400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308415c7b0 con 0x7f30840ae710 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3089400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30840aeb90 con 0x7f308415c3e0 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3082800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f308415c3e0 0x7f30840ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3082800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f308415c3e0 0x7f30840ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32860/0 (socket says 172.21.15.46:32860) 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3082800640 1 -- 172.21.15.46:0/103858875 learned_addr learned my addr 172.21.15.46:0/103858875 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3083200640 1 --1- 172.21.15.46:0/103858875 >> v1:172.21.15.46:6789/0 conn(0x7f3084068140 0x7f308415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54238/0 (socket says 172.21.15.46:54238) 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3082800640 1 -- 172.21.15.46:0/103858875 >> v1:172.21.15.162:6789/0 conn(0x7f30840ae710 legacy=0x7f3084067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.156+0000 7f3082800640 1 -- 172.21.15.46:0/103858875 >> v1:172.21.15.46:6789/0 conn(0x7f3084068140 legacy=0x7f308415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.157+0000 7f3081e00640 1 -- 172.21.15.46:0/103858875 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403816335 0 0) 0x7f3084068560 con 0x7f3084068140 2024-08-17T02:28:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.157+0000 7f3082800640 1 -- 172.21.15.46:0/103858875 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308415a030 con 0x7f308415c3e0 2024-08-17T02:28:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3082800640 1 --2- 172.21.15.46:0/103858875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308415c3e0 0x7f30840ae1d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3074009910 tx=0x7f30740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a55c9b54305f4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3081e00640 1 -- 172.21.15.46:0/103858875 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307402add0 con 0x7f308415c3e0 2024-08-17T02:28:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3081e00640 1 -- 172.21.15.46:0/103858875 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3074032440 con 0x7f308415c3e0 2024-08-17T02:28:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3081e00640 1 -- 172.21.15.46:0/103858875 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30740327e0 con 0x7f308415c3e0 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3089400640 1 -- 172.21.15.46:0/103858875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308415c3e0 msgr2=0x7f30840ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3089400640 1 --2- 172.21.15.46:0/103858875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308415c3e0 0x7f30840ae1d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3074009910 tx=0x7f30740091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3089400640 1 -- 172.21.15.46:0/103858875 shutdown_connections 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3089400640 1 --2- 172.21.15.46:0/103858875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f308415c3e0 0x7f30840ae1d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.158+0000 7f3089400640 1 -- 172.21.15.46:0/103858875 >> 172.21.15.46:0/103858875 conn(0x7f30840b17a0 msgr2=0x7f30840b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.159+0000 7f3089400640 1 -- 172.21.15.46:0/103858875 shutdown_connections 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.159+0000 7f3089400640 1 -- 172.21.15.46:0/103858875 wait complete. 2024-08-17T02:28:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.160+0000 7f3089400640 1 Processor -- start 2024-08-17T02:28:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.160+0000 7f3089400640 1 -- start start 2024-08-17T02:28:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 0x7f30841510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308415c3e0 0x7f308416bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084151620 con 0x7f3084068140 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3084151830 con 0x7f308415c3e0 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3089400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3084151b10 con 0x7f30840ae710 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32870/0 (socket says 172.21.15.46:32870) 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 -- 172.21.15.46:0/4190993354 learned_addr learned my addr 172.21.15.46:0/4190993354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3083200640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308415c3e0 0x7f308416bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3079e00640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 0x7f30841510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 -- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 msgr2=0x7f30841510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 0x7f30841510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 -- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308415c3e0 msgr2=0x7f308416bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308415c3e0 0x7f308416bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3082800640 1 -- 172.21.15.46:0/4190993354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074009450 con 0x7f3084068140 2024-08-17T02:28:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.161+0000 7f3079e00640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 0x7f30841510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f3082800640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3074035040 tx=0x7f3074032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074031a60 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3074031be0 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307403d420 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3084151df0 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.162+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30841523b0 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.163+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30841525f0 con 0x7f3084068140 2024-08-17T02:28:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.164+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3074039040 con 0x7f3084068140 2024-08-17T02:28:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.165+0000 7f307aa00640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 0x7f3060067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.165+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f30740a20f0 con 0x7f3084068140 2024-08-17T02:28:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.165+0000 7f3079e00640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 0x7f3060067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.166+0000 7f3079e00640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 0x7f3060067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f308406a270 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.169+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3074070110 con 0x7f3084068140 2024-08-17T02:28:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.349+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3084071050 con 0x7f3084068140 2024-08-17T02:28:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.349+0000 7f307aa00640 1 -- 172.21.15.46:0/4190993354 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3074073730 con 0x7f3084068140 2024-08-17T02:28:08.350 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 msgr2=0x7f3060067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 0x7f3060067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f308406a270 tx=0x7f306c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 msgr2=0x7f30840ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3074035040 tx=0x7f3074032000 comp rx=0 tx=0).stop 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 shutdown_connections 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308415c3e0 0x7f308416bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3060065150 0x7f3060067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30840ae710 0x7f30841510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 --2- 172.21.15.46:0/4190993354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3084068140 0x7f30840ac8d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 >> 172.21.15.46:0/4190993354 conn(0x7f30840b17a0 msgr2=0x7f308406a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 shutdown_connections 2024-08-17T02:28:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.351+0000 7f3089400640 1 -- 172.21.15.46:0/4190993354 wait complete. 2024-08-17T02:28:08.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.520+0000 7f0f3da00640 1 Processor -- start 2024-08-17T02:28:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.520+0000 7f0f3da00640 1 -- start start 2024-08-17T02:28:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f3da00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f380d0890 0x7f0f380b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f3da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f380b0d50 0x7f0f380b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f3da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380afbb0 con 0x7f0f3815c2f0 2024-08-17T02:28:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f3da00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380b1e10 con 0x7f0f380d0890 2024-08-17T02:28:08.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f3da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b11d0 con 0x7f0f380b0d50 2024-08-17T02:28:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f36000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f380d0890 0x7f0f380b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f36000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0f380d0890 0x7f0f380b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32884/0 (socket says 172.21.15.46:32884) 2024-08-17T02:28:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.521+0000 7f0f36000640 1 -- 172.21.15.46:0/4153665238 learned_addr learned my addr 172.21.15.46:0/4153665238 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:08.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.522+0000 7f0f36000640 1 -- 172.21.15.46:0/4153665238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f380b0d50 msgr2=0x7f0f380b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.522+0000 7f0f36000640 1 --2- 172.21.15.46:0/4153665238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f380b0d50 0x7f0f380b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.522+0000 7f0f36000640 1 -- 172.21.15.46:0/4153665238 >> v1:172.21.15.162:6789/0 conn(0x7f0f3815c2f0 legacy=0x7f0f380af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.522+0000 7f0f36000640 1 -- 172.21.15.46:0/4153665238 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380afe90 con 0x7f0f380d0890 2024-08-17T02:28:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.523+0000 7f0f36000640 1 --2- 172.21.15.46:0/4153665238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f380b0810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f3804c270 tx=0x7f0f240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1647239ad7c8f44f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.523+0000 7f0f35600640 1 -- 172.21.15.46:0/4153665238 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2402adb0 con 0x7f0f380d0890 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.523+0000 7f0f35600640 1 -- 172.21.15.46:0/4153665238 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24032440 con 0x7f0f380d0890 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.523+0000 7f0f35600640 1 -- 172.21.15.46:0/4153665238 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240327e0 con 0x7f0f380d0890 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 -- 172.21.15.46:0/4153665238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 msgr2=0x7f0f380b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 --2- 172.21.15.46:0/4153665238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f380b0810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f3804c270 tx=0x7f0f240091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 -- 172.21.15.46:0/4153665238 shutdown_connections 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 --2- 172.21.15.46:0/4153665238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f380b0d50 0x7f0f380b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 --2- 172.21.15.46:0/4153665238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f380b0810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 -- 172.21.15.46:0/4153665238 >> 172.21.15.46:0/4153665238 conn(0x7f0f380cfdb0 msgr2=0x7f0f380d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 -- 172.21.15.46:0/4153665238 shutdown_connections 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.524+0000 7f0f3da00640 1 -- 172.21.15.46:0/4153665238 wait complete. 2024-08-17T02:28:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.525+0000 7f0f3da00640 1 Processor -- start 2024-08-17T02:28:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.525+0000 7f0f3da00640 1 -- start start 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f380b0d50 0x7f0f38169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3815c2f0 0x7f0f3809d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3816a2e0 con 0x7f0f380d0890 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380cec30 con 0x7f0f380b0d50 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.526+0000 7f0f3da00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380ce020 con 0x7f0f3815c2f0 2024-08-17T02:28:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32886/0 (socket says 172.21.15.46:32886) 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 -- 172.21.15.46:0/2967898659 learned_addr learned my addr 172.21.15.46:0/2967898659 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f37400640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3815c2f0 0x7f0f3809d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36a00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f380b0d50 0x7f0f38169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 -- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3815c2f0 msgr2=0x7f0f3809d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3815c2f0 0x7f0f3809d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 -- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f380b0d50 msgr2=0x7f0f38169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f380b0d50 0x7f0f38169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 -- 172.21.15.46:0/2967898659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24009450 con 0x7f0f380d0890 2024-08-17T02:28:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.527+0000 7f0f36000640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f24035040 tx=0x7f0f24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.528+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24031b30 con 0x7f0f380d0890 2024-08-17T02:28:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.528+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24031cb0 con 0x7f0f380d0890 2024-08-17T02:28:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.528+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2403e6a0 con 0x7f0f380d0890 2024-08-17T02:28:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.528+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f380ce300 con 0x7f0f380d0890 2024-08-17T02:28:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.528+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f380ce8c0 con 0x7f0f380d0890 2024-08-17T02:28:08.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.529+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3816a450 con 0x7f0f380d0890 2024-08-17T02:28:08.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.530+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0f2403c400 con 0x7f0f380d0890 2024-08-17T02:28:08.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.531+0000 7f0f2e000640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 0x7f0f18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.531+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f240a2890 con 0x7f0f380d0890 2024-08-17T02:28:08.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.531+0000 7f0f36a00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 0x7f0f18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.532+0000 7f0f36a00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 0x7f0f18067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800b8d0 tx=0x7f0f28008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.535+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0f3816a450 con 0x7f0f380d0890 2024-08-17T02:28:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.715+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f3816a450 con 0x7f0f380d0890 2024-08-17T02:28:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.715+0000 7f0f2e000640 1 -- 172.21.15.46:0/2967898659 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f3816a450 con 0x7f0f380d0890 2024-08-17T02:28:08.716 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.717+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 msgr2=0x7f0f18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.717+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 0x7f0f18067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800b8d0 tx=0x7f0f28008040 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.717+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 msgr2=0x7f0f3809cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.717+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f24035040 tx=0x7f0f24032000 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 shutdown_connections 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f18065150 0x7f0f18067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f3815c2f0 0x7f0f3809d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f380d0890 0x7f0f3809cc30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 --2- 172.21.15.46:0/2967898659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f380b0d50 0x7f0f38169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 >> 172.21.15.46:0/2967898659 conn(0x7f0f380cfdb0 msgr2=0x7f0f38159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 shutdown_connections 2024-08-17T02:28:08.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.718+0000 7f0f3da00640 1 -- 172.21.15.46:0/2967898659 wait complete. 2024-08-17T02:28:08.733 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:08.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.884+0000 7fa411600640 1 Processor -- start 2024-08-17T02:28:08.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.885+0000 7fa411600640 1 -- start start 2024-08-17T02:28:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa411600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa411600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c157690 con 0x7fa40c0b0270 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa411600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c156a80 con 0x7fa40c158b30 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa411600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c156d60 con 0x7fa40c155900 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa40b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fa40c0b0270 0x7fa40c156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54244/0 (socket says 172.21.15.46:54244) 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa40b400640 1 -- 172.21.15.46:0/3573551500 learned_addr learned my addr 172.21.15.46:0/3573551500 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa40be00640 1 --2- 172.21.15.46:0/3573551500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.886+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668910971 0 0) 0x7fa40c157690 con 0x7fa40c0b0270 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f00034e0 con 0x7fa40c0b0270 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611644090 0 0) 0x7fa40c156a80 con 0x7fa40c158b30 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa40c157690 con 0x7fa40c158b30 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40be00640 1 -- 172.21.15.46:0/3573551500 >> v1:172.21.15.162:6789/0 conn(0x7fa40c158b30 legacy=0x7fa40c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40be00640 1 -- 172.21.15.46:0/3573551500 >> v1:172.21.15.46:6789/0 conn(0x7fa40c0b0270 legacy=0x7fa40c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020106931 0 0) 0x7fa3f00034e0 con 0x7fa40c0b0270 2024-08-17T02:28:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.887+0000 7fa40be00640 1 -- 172.21.15.46:0/3573551500 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c157040 con 0x7fa40c155900 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.888+0000 7fa40be00640 1 --2- 172.21.15.46:0/3573551500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c155cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009880 tx=0x7fa3fc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6b21c695420c48 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.888+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8001470 con 0x7fa40c155900 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.888+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc02aa30 con 0x7fa40c155900 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.888+0000 7fa40aa00640 1 -- 172.21.15.46:0/3573551500 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc02adb0 con 0x7fa40c155900 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 -- 172.21.15.46:0/3573551500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 msgr2=0x7fa40c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 --2- 172.21.15.46:0/3573551500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c155cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009880 tx=0x7fa3fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 -- 172.21.15.46:0/3573551500 shutdown_connections 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 --2- 172.21.15.46:0/3573551500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c155cd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 -- 172.21.15.46:0/3573551500 >> 172.21.15.46:0/3573551500 conn(0x7fa40c067750 msgr2=0x7fa40c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 -- 172.21.15.46:0/3573551500 shutdown_connections 2024-08-17T02:28:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.889+0000 7fa411600640 1 -- 172.21.15.46:0/3573551500 wait complete. 2024-08-17T02:28:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.890+0000 7fa411600640 1 Processor -- start 2024-08-17T02:28:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.890+0000 7fa411600640 1 -- start start 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa40c0b0270 0x7fa40c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c149330 con 0x7fa40c158b30 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1459d0 con 0x7fa40c0b0270 2024-08-17T02:28:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.891+0000 7fa411600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1487b0 con 0x7fa40c155900 2024-08-17T02:28:08.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32892/0 (socket says 172.21.15.46:32892) 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 -- 172.21.15.46:0/534309022 learned_addr learned my addr 172.21.15.46:0/534309022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa40be00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa40c0b0270 0x7fa40c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa40b400640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 -- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 msgr2=0x7fa40c143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 -- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa40c0b0270 msgr2=0x7fa40c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa40c0b0270 0x7fa40c14a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 -- 172.21.15.46:0/534309022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3fc009390 con 0x7fa40c158b30 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.892+0000 7fa410c00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c840 tx=0x7fa404002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.893+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400a640 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.893+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400a7a0 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.893+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400ab60 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.893+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c148a90 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.893+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c14ab50 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.894+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c071050 con 0x7fa40c158b30 2024-08-17T02:28:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.895+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa404012420 con 0x7fa40c158b30 2024-08-17T02:28:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.895+0000 7fa403400640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 0x7fa3ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.895+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa404082720 con 0x7fa40c158b30 2024-08-17T02:28:08.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.896+0000 7fa40be00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 0x7fa3ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.897+0000 7fa40be00640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 0x7fa3ec067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:08.899+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4040508b0 con 0x7fa40c158b30 2024-08-17T02:28:09.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.084+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa40c06f480 con 0x7fa40c158b30 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.084+0000 7fa403400640 1 -- 172.21.15.46:0/534309022 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fa404053ed0 con 0x7fa40c158b30 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:09.085 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.086+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 msgr2=0x7fa3ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.086+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 0x7fa3ec067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc034000 tx=0x7fa3fc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.086+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 msgr2=0x7fa40c141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.086+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c840 tx=0x7fa404002650 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 shutdown_connections 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa40c158b30 0x7fa40c141c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa3ec065150 0x7fa3ec067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa40c155900 0x7fa40c143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 --2- 172.21.15.46:0/534309022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa40c0b0270 0x7fa40c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 >> 172.21.15.46:0/534309022 conn(0x7fa40c067750 msgr2=0x7fa40c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 shutdown_connections 2024-08-17T02:28:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.087+0000 7fa411600640 1 -- 172.21.15.46:0/534309022 wait complete. 2024-08-17T02:28:09.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:09.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:09.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.256+0000 7f3345e00640 1 Processor -- start 2024-08-17T02:28:09.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.257+0000 7f3345e00640 1 -- start start 2024-08-17T02:28:09.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f334006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f334015e710 0x7f33400adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400ad680 con 0x7f334015eb60 2024-08-17T02:28:09.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3340161ae0 con 0x7f334015e710 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340161800 con 0x7f334006df00 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f334015eb60 0x7f3340160b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54254/0 (socket says 172.21.15.46:54254) 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3345400640 1 -- 172.21.15.46:0/11343659 learned_addr learned my addr 172.21.15.46:0/11343659 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f333fe00640 1 --2- 172.21.15.46:0/11343659 >> v2:172.21.15.162:3300/0 conn(0x7f334015e710 0x7f33400adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.258+0000 7f3344a00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f334006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144762171 0 0) 0x7f33400ad680 con 0x7f334015eb60 2024-08-17T02:28:09.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33280034e0 con 0x7f334015eb60 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670802816 0 0) 0x7f33280034e0 con 0x7f334015eb60 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333fe00640 1 -- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 msgr2=0x7f334006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333fe00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f334006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333fe00640 1 -- 172.21.15.46:0/11343659 >> v1:172.21.15.46:6789/0 conn(0x7f334015eb60 legacy=0x7f3340160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f333fe00640 1 -- 172.21.15.46:0/11343659 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400ad030 con 0x7f334015e710 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.259+0000 7f3344a00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f334006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:09.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.260+0000 7f333fe00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015e710 0x7f33400adb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8743008762a5924f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.260+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380017f0 con 0x7f334015e710 2024-08-17T02:28:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.260+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c02a9c0 con 0x7f334015e710 2024-08-17T02:28:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.260+0000 7f333f400640 1 -- 172.21.15.46:0/11343659 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c02ad60 con 0x7f334015e710 2024-08-17T02:28:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 -- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015e710 msgr2=0x7f33400adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015e710 0x7f33400adb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 -- 172.21.15.46:0/11343659 shutdown_connections 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015e710 0x7f33400adb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 --2- 172.21.15.46:0/11343659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f334006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 -- 172.21.15.46:0/11343659 >> 172.21.15.46:0/11343659 conn(0x7f3340067750 msgr2=0x7f334006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 -- 172.21.15.46:0/11343659 shutdown_connections 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.261+0000 7f3345e00640 1 -- 172.21.15.46:0/11343659 wait complete. 2024-08-17T02:28:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.262+0000 7f3345e00640 1 Processor -- start 2024-08-17T02:28:09.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.262+0000 7f3345e00640 1 -- start start 2024-08-17T02:28:09.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f3340153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015eb60 0x7f33400adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401574e0 con 0x7f334015e710 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401568d0 con 0x7f334015eb60 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.263+0000 7f3345e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340156bb0 con 0x7f334006df00 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32904/0 (socket says 172.21.15.46:32904) 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 -- 172.21.15.46:0/1197248704 learned_addr learned my addr 172.21.15.46:0/1197248704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f3345400640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015eb60 0x7f33400adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f3344a00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f3340153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 -- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 msgr2=0x7f3340153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f3340153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 -- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015eb60 msgr2=0x7f33400adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015eb60 0x7f33400adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 -- 172.21.15.46:0/1197248704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3334009390 con 0x7f334015e710 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.264+0000 7f333fe00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.265+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c032e60 con 0x7f334015e710 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.265+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c03d420 con 0x7f334015e710 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.265+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c03d7e0 con 0x7f334015e710 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.265+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c009390 con 0x7f334015e710 2024-08-17T02:28:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.265+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3340157170 con 0x7f334015e710 2024-08-17T02:28:09.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.266+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340071050 con 0x7f334015e710 2024-08-17T02:28:09.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.267+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f332c039040 con 0x7f334015e710 2024-08-17T02:28:09.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.267+0000 7f3333e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 0x7f3320067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.268+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f332c0a1900 con 0x7f334015e710 2024-08-17T02:28:09.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.268+0000 7f3344a00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 0x7f3320067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.269+0000 7f3344a00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 0x7f3320067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3334009360 tx=0x7f3334008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.272+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f332c06f9c0 con 0x7f334015e710 2024-08-17T02:28:09.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.459+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3340159da0 con 0x7f334015e710 2024-08-17T02:28:09.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.459+0000 7f3333e00640 1 -- 172.21.15.46:0/1197248704 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f332c0370a0 con 0x7f334015e710 2024-08-17T02:28:09.460 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.461+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 msgr2=0x7f3320067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.461+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 0x7f3320067630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3334009360 tx=0x7f3334008040 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.461+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 msgr2=0x7f33400a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.461+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f332c009850 tx=0x7f332c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 shutdown_connections 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f334015eb60 0x7f33400adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f334015e710 0x7f33400a60e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3320065180 0x7f3320067630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 --2- 172.21.15.46:0/1197248704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f334006df00 0x7f3340153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 >> 172.21.15.46:0/1197248704 conn(0x7f3340067750 msgr2=0x7f334006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 shutdown_connections 2024-08-17T02:28:09.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.462+0000 7f3345e00640 1 -- 172.21.15.46:0/1197248704 wait complete. 2024-08-17T02:28:09.477 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:09.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.631+0000 7fede8c00640 1 Processor -- start 2024-08-17T02:28:09.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.631+0000 7fede8c00640 1 -- start start 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede8c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fede4158ce0 0x7fede406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 0x7fede40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede8c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede406d790 con 0x7fede40c9110 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede8c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40c95b0 con 0x7fede4158ce0 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede406a730 con 0x7fede41590b0 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.632+0000 7fede1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fede4158ce0 0x7fede406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fede4158ce0 0x7fede406a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32920/0 (socket says 172.21.15.46:32920) 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 -- 172.21.15.46:0/1434053325 learned_addr learned my addr 172.21.15.46:0/1434053325 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede2800640 1 --1- 172.21.15.46:0/1434053325 >> v1:172.21.15.46:6789/0 conn(0x7fede40c9110 0x7fede415c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54268/0 (socket says 172.21.15.46:54268) 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1400640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 0x7fede40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 -- 172.21.15.46:0/1434053325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 msgr2=0x7fede40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 0x7fede40c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 -- 172.21.15.46:0/1434053325 >> v1:172.21.15.46:6789/0 conn(0x7fede40c9110 legacy=0x7fede415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1e00640 1 -- 172.21.15.46:0/1434053325 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede406cb80 con 0x7fede4158ce0 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede0a00640 1 -- 172.21.15.46:0/1434053325 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602868707 0 0) 0x7fede406d790 con 0x7fede40c9110 2024-08-17T02:28:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.633+0000 7fede1400640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 0x7fede40c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.634+0000 7fede1e00640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede4158ce0 0x7fede406a1f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009910 tx=0x7fedd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6652257b9fae65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.634+0000 7fede0a00640 1 -- 172.21.15.46:0/1434053325 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd402ae40 con 0x7fede4158ce0 2024-08-17T02:28:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.634+0000 7fede0a00640 1 -- 172.21.15.46:0/1434053325 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4032440 con 0x7fede4158ce0 2024-08-17T02:28:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.634+0000 7fede0a00640 1 -- 172.21.15.46:0/1434053325 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd40327e0 con 0x7fede4158ce0 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 -- 172.21.15.46:0/1434053325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede4158ce0 msgr2=0x7fede406a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede4158ce0 0x7fede406a1f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009910 tx=0x7fedd40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 -- 172.21.15.46:0/1434053325 shutdown_connections 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede41590b0 0x7fede40c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 --2- 172.21.15.46:0/1434053325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede4158ce0 0x7fede406a1f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 -- 172.21.15.46:0/1434053325 >> 172.21.15.46:0/1434053325 conn(0x7fede4067750 msgr2=0x7fede40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 -- 172.21.15.46:0/1434053325 shutdown_connections 2024-08-17T02:28:09.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.635+0000 7fede8c00640 1 -- 172.21.15.46:0/1434053325 wait complete. 2024-08-17T02:28:09.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.636+0000 7fede8c00640 1 Processor -- start 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.636+0000 7fede8c00640 1 -- start start 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede4158ce0 0x7fede4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 0x7fede415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4149cd0 con 0x7fede40c9110 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede415bdf0 con 0x7fede41590b0 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede8c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede415c0d0 con 0x7fede4158ce0 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.637+0000 7fede1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32926/0 (socket says 172.21.15.46:32926) 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 -- 172.21.15.46:0/3640990355 learned_addr learned my addr 172.21.15.46:0/3640990355 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede2800640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 0x7fede415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1400640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede4158ce0 0x7fede4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 -- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede4158ce0 msgr2=0x7fede4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede4158ce0 0x7fede4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 -- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 msgr2=0x7fede415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 0x7fede415cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 -- 172.21.15.46:0/3640990355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4009450 con 0x7fede40c9110 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede2800640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 0x7fede415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.638+0000 7fede1e00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedd4035040 tx=0x7fedd4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.639+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4031de0 con 0x7fede40c9110 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.639+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd403d420 con 0x7fede40c9110 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.639+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd403d820 con 0x7fede40c9110 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.639+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede415c3b0 con 0x7fede40c9110 2024-08-17T02:28:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.639+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede415a400 con 0x7fede40c9110 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.640+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4071050 con 0x7fede40c9110 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.641+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fedd4039040 con 0x7fede40c9110 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.641+0000 7fedd9600640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 0x7fedc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.641+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedd402ae40 con 0x7fede40c9110 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.642+0000 7fede1400640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 0x7fedc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.643+0000 7fede1400640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 0x7fedc4067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.645+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fedd4070990 con 0x7fede40c9110 2024-08-17T02:28:09.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.829+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fede406e5d0 con 0x7fede40c9110 2024-08-17T02:28:09.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.830+0000 7fedd9600640 1 -- 172.21.15.46:0/3640990355 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedd4073fb0 con 0x7fede40c9110 2024-08-17T02:28:09.831 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:09.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 msgr2=0x7fedc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 0x7fedc4067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedd0006fd0 tx=0x7fedd0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 msgr2=0x7fede4149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fedd4035040 tx=0x7fedd4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 shutdown_connections 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fede41590b0 0x7fede415cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fedc4065150 0x7fedc4067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fede4158ce0 0x7fede4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 --2- 172.21.15.46:0/3640990355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fede40c9110 0x7fede4149790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.832+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 >> 172.21.15.46:0/3640990355 conn(0x7fede4067750 msgr2=0x7fede41534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.833+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 shutdown_connections 2024-08-17T02:28:09.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:09.833+0000 7fede8c00640 1 -- 172.21.15.46:0/3640990355 wait complete. 2024-08-17T02:28:09.850 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:10.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.004+0000 7f5861a00640 1 Processor -- start 2024-08-17T02:28:10.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.004+0000 7f5861a00640 1 -- start start 2024-08-17T02:28:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f5861a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 0x7f585c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f5861a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f585c0abb00 0x7f585c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f5861a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0ab130 con 0x7f585c156c50 2024-08-17T02:28:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f5861a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0ae5a0 con 0x7f585c0abb00 2024-08-17T02:28:10.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f5861a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0ae2c0 con 0x7f585c0adcf0 2024-08-17T02:28:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f585aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f585c156c50 0x7f585c0c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44944/0 (socket says 172.21.15.46:44944) 2024-08-17T02:28:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.005+0000 7f585aa00640 1 -- 172.21.15.46:0/450869794 learned_addr learned my addr 172.21.15.46:0/450869794 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585b400640 1 --2- 172.21.15.46:0/450869794 >> v2:172.21.15.162:3300/0 conn(0x7f585c0abb00 0x7f585c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585a000640 1 --2- 172.21.15.46:0/450869794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 0x7f585c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f5859600640 1 -- 172.21.15.46:0/450869794 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427175342 0 0) 0x7f585c0ab130 con 0x7f585c156c50 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f5859600640 1 -- 172.21.15.46:0/450869794 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58400034e0 con 0x7f585c156c50 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585a000640 1 -- 172.21.15.46:0/450869794 >> v2:172.21.15.162:3300/0 conn(0x7f585c0abb00 msgr2=0x7f585c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585a000640 1 --2- 172.21.15.46:0/450869794 >> v2:172.21.15.162:3300/0 conn(0x7f585c0abb00 0x7f585c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585a000640 1 -- 172.21.15.46:0/450869794 >> v1:172.21.15.46:6789/0 conn(0x7f585c156c50 legacy=0x7f585c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.006+0000 7f585a000640 1 -- 172.21.15.46:0/450869794 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0aaae0 con 0x7f585c0adcf0 2024-08-17T02:28:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.007+0000 7f585a000640 1 --2- 172.21.15.46:0/450869794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 0x7f585c0ab5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5848009850 tx=0x7f58480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f42c09691e54f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5859600640 1 -- 172.21.15.46:0/450869794 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584802ad00 con 0x7f585c0adcf0 2024-08-17T02:28:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5859600640 1 -- 172.21.15.46:0/450869794 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584802ae60 con 0x7f585c0adcf0 2024-08-17T02:28:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5859600640 1 -- 172.21.15.46:0/450869794 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848032670 con 0x7f585c0adcf0 2024-08-17T02:28:10.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 -- 172.21.15.46:0/450869794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 msgr2=0x7f585c0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 --2- 172.21.15.46:0/450869794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 0x7f585c0ab5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5848009850 tx=0x7f58480090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 -- 172.21.15.46:0/450869794 shutdown_connections 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 --2- 172.21.15.46:0/450869794 >> v2:172.21.15.162:3300/0 conn(0x7f585c0abb00 0x7f585c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 --2- 172.21.15.46:0/450869794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0adcf0 0x7f585c0ab5c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 -- 172.21.15.46:0/450869794 >> 172.21.15.46:0/450869794 conn(0x7f585c067750 msgr2=0x7f585c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 -- 172.21.15.46:0/450869794 shutdown_connections 2024-08-17T02:28:10.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.008+0000 7f5861a00640 1 -- 172.21.15.46:0/450869794 wait complete. 2024-08-17T02:28:10.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.010+0000 7f5861a00640 1 Processor -- start 2024-08-17T02:28:10.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.010+0000 7f5861a00640 1 -- start start 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0abb00 0x7f585c14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f585c156c50 0x7f585c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c14ce30 con 0x7f585c0adcf0 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c157370 con 0x7f585c156c50 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f5861a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c157650 con 0x7f585c0abb00 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43390/0 (socket says 172.21.15.46:43390) 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 -- 172.21.15.46:0/301740936 learned_addr learned my addr 172.21.15.46:0/301740936 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585aa00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0abb00 0x7f585c14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585b400640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f585c156c50 0x7f585c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 -- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0abb00 msgr2=0x7f585c14c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0abb00 0x7f585c14c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 -- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f585c156c50 msgr2=0x7f585c159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f585c156c50 0x7f585c159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.011+0000 7f585a000640 1 -- 172.21.15.46:0/301740936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009390 con 0x7f585c0adcf0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f585a000640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5848009360 tx=0x7f5848032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584803c750 con 0x7f585c0adcf0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584803c8b0 con 0x7f585c0adcf0 2024-08-17T02:28:10.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584803cc50 con 0x7f585c0adcf0 2024-08-17T02:28:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c157930 con 0x7f585c0adcf0 2024-08-17T02:28:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.012+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c157ef0 con 0x7f585c0adcf0 2024-08-17T02:28:10.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.013+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c1580e0 con 0x7f585c0adcf0 2024-08-17T02:28:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.014+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5848044030 con 0x7f585c0adcf0 2024-08-17T02:28:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.015+0000 7f5852000640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 0x7f583c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.015+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5848042070 con 0x7f585c0adcf0 2024-08-17T02:28:10.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.015+0000 7f585aa00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 0x7f583c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.016+0000 7f585aa00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 0x7f583c067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f584c005840 tx=0x7f584c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.019+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5848071000 con 0x7f585c0adcf0 2024-08-17T02:28:10.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.198+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f585c071050 con 0x7f585c0adcf0 2024-08-17T02:28:10.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.199+0000 7f5852000640 1 -- 172.21.15.46:0/301740936 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f584804c0a0 con 0x7f585c0adcf0 2024-08-17T02:28:10.200 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 msgr2=0x7f583c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 0x7f583c067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f584c005840 tx=0x7f584c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 msgr2=0x7f585c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5848009360 tx=0x7f5848032000 comp rx=0 tx=0).stop 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 shutdown_connections 2024-08-17T02:28:10.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f585c156c50 0x7f585c159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f585c0adcf0 0x7f585c151100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f583c065150 0x7f583c067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 --2- 172.21.15.46:0/301740936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f585c0abb00 0x7f585c14c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 >> 172.21.15.46:0/301740936 conn(0x7f585c067750 msgr2=0x7f585c0c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 shutdown_connections 2024-08-17T02:28:10.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.201+0000 7f5861a00640 1 -- 172.21.15.46:0/301740936 wait complete. 2024-08-17T02:28:10.289 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:28:10.290 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:10.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:10.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.442+0000 7fd2bf200640 1 Processor -- start 2024-08-17T02:28:10.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.442+0000 7fd2bf200640 1 -- start start 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.443+0000 7fd2bf200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2b8155a20 0x7fd2b80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.443+0000 7fd2bf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b8155df0 0x7fd2b80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.443+0000 7fd2bf200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b8156670 con 0x7fd2b806d7f0 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.443+0000 7fd2bf200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b80b0350 con 0x7fd2b8155a20 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.443+0000 7fd2bf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b806e5e0 con 0x7fd2b8155df0 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2b8155a20 0x7fd2b80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd2b8155a20 0x7fd2b80adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43400/0 (socket says 172.21.15.46:43400) 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 -- 172.21.15.46:0/74049814 learned_addr learned my addr 172.21.15.46:0/74049814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7400640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b8155df0 0x7fd2b80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 -- 172.21.15.46:0/74049814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b8155df0 msgr2=0x7fd2b80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b8155df0 0x7fd2b80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 -- 172.21.15.46:0/74049814 >> v1:172.21.15.46:6789/0 conn(0x7fd2b806d7f0 legacy=0x7fd2b80ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.444+0000 7fd2b7e00640 1 -- 172.21.15.46:0/74049814 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b806e8c0 con 0x7fd2b8155a20 2024-08-17T02:28:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.445+0000 7fd2b7e00640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b80adf10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009910 tx=0x7fd2a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cc73a1c0481c8d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.445+0000 7fd2b6a00640 1 -- 172.21.15.46:0/74049814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a802ae40 con 0x7fd2b8155a20 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2b6a00640 1 -- 172.21.15.46:0/74049814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a8032440 con 0x7fd2b8155a20 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2b6a00640 1 -- 172.21.15.46:0/74049814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8032820 con 0x7fd2b8155a20 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 -- 172.21.15.46:0/74049814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 msgr2=0x7fd2b80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b80adf10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009910 tx=0x7fd2a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 -- 172.21.15.46:0/74049814 shutdown_connections 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b8155df0 0x7fd2b80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 --2- 172.21.15.46:0/74049814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b80adf10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 -- 172.21.15.46:0/74049814 >> 172.21.15.46:0/74049814 conn(0x7fd2b80cb9b0 msgr2=0x7fd2b80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 -- 172.21.15.46:0/74049814 shutdown_connections 2024-08-17T02:28:10.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.446+0000 7fd2bf200640 1 -- 172.21.15.46:0/74049814 wait complete. 2024-08-17T02:28:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.448+0000 7fd2bf200640 1 Processor -- start 2024-08-17T02:28:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.448+0000 7fd2bf200640 1 -- start start 2024-08-17T02:28:10.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b806d7f0 0x7fd2b80c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 0x7fd2b8069e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8169f60 con 0x7fd2b8155a20 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80c1e70 con 0x7fd2b8155df0 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bf200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80c2150 con 0x7fd2b806d7f0 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43404/0 (socket says 172.21.15.46:43404) 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 -- 172.21.15.46:0/1740206855 learned_addr learned my addr 172.21.15.46:0/1740206855 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 -- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b806d7f0 msgr2=0x7fd2b80c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b806d7f0 0x7fd2b80c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 -- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 msgr2=0x7fd2b8069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bd200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 0x7fd2b8069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 0x7fd2b8069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2b7400640 1 -- 172.21.15.46:0/1740206855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8009450 con 0x7fd2b8155a20 2024-08-17T02:28:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.449+0000 7fd2bd200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 0x7fd2b8069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:10.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2b7400640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400d890 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a400de20 con 0x7fd2b8155a20 2024-08-17T02:28:10.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a40098b0 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b80c2430 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4009c50 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.450+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b816a120 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.451+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8064db0 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.452+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2a4014620 con 0x7fd2b8155a20 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.453+0000 7fd2af400640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 0x7fd298067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.453+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2a4082d30 con 0x7fd2b8155a20 2024-08-17T02:28:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.453+0000 7fd2b7e00640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 0x7fd298067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.454+0000 7fd2b7e00640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 0x7fd298067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8034000 tx=0x7fd2a8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.457+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2a4050d50 con 0x7fd2b8155a20 2024-08-17T02:28:10.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.643+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2b80c1fb0 con 0x7fd2b8155a20 2024-08-17T02:28:10.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.644+0000 7fd2af400640 1 -- 172.21.15.46:0/1740206855 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd2b80c1fb0 con 0x7fd2b8155a20 2024-08-17T02:28:10.645 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:10.645 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:10.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 msgr2=0x7fd298067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 0x7fd298067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8034000 tx=0x7fd2a8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 msgr2=0x7fd2b8069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400d890 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 shutdown_connections 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8155df0 0x7fd2b8069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2b8155a20 0x7fd2b8069930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd298065150 0x7fd298067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 --2- 172.21.15.46:0/1740206855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2b806d7f0 0x7fd2b80c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.646+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 >> 172.21.15.46:0/1740206855 conn(0x7fd2b80cb9b0 msgr2=0x7fd2b8158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.647+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 shutdown_connections 2024-08-17T02:28:10.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.647+0000 7fd2bf200640 1 -- 172.21.15.46:0/1740206855 wait complete. 2024-08-17T02:28:10.662 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.815+0000 7fd743200640 1 Processor -- start 2024-08-17T02:28:10.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.815+0000 7fd743200640 1 -- start start 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd743200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd74406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd743200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd74415a0e0 0x7fd7440aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd743200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7440af5f0 con 0x7fd7440aae40 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd743200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd744159600 con 0x7fd74415a0e0 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd743200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7441598e0 con 0x7fd74406df00 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd742800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd7440aae40 0x7fd7440ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44970/0 (socket says 172.21.15.46:44970) 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd742800640 1 -- 172.21.15.46:0/1492740932 learned_addr learned my addr 172.21.15.46:0/1492740932 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd741400640 1 --2- 172.21.15.46:0/1492740932 >> v2:172.21.15.162:3300/0 conn(0x7fd74415a0e0 0x7fd7440aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.817+0000 7fd741e00640 1 --2- 172.21.15.46:0/1492740932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd74406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.818+0000 7fd741e00640 1 -- 172.21.15.46:0/1492740932 >> v2:172.21.15.162:3300/0 conn(0x7fd74415a0e0 msgr2=0x7fd7440aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.818+0000 7fd741e00640 1 --2- 172.21.15.46:0/1492740932 >> v2:172.21.15.162:3300/0 conn(0x7fd74415a0e0 0x7fd7440aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.818+0000 7fd740a00640 1 -- 172.21.15.46:0/1492740932 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355721166 0 0) 0x7fd7440af5f0 con 0x7fd7440aae40 2024-08-17T02:28:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.818+0000 7fd741e00640 1 -- 172.21.15.46:0/1492740932 >> v1:172.21.15.46:6789/0 conn(0x7fd7440aae40 legacy=0x7fd7440ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.818+0000 7fd741e00640 1 -- 172.21.15.46:0/1492740932 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744159bc0 con 0x7fd74406df00 2024-08-17T02:28:10.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.819+0000 7fd741e00640 1 --2- 172.21.15.46:0/1492740932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd74406e2d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73400baf0 tx=0x7fd73400b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba54149ae2e2bd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.819+0000 7fd740a00640 1 -- 172.21.15.46:0/1492740932 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340325e0 con 0x7fd74406df00 2024-08-17T02:28:10.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.819+0000 7fd740a00640 1 -- 172.21.15.46:0/1492740932 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734032740 con 0x7fd74406df00 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.819+0000 7fd740a00640 1 -- 172.21.15.46:0/1492740932 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734032ae0 con 0x7fd74406df00 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.819+0000 7fd743200640 1 -- 172.21.15.46:0/1492740932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 msgr2=0x7fd74406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 --2- 172.21.15.46:0/1492740932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd74406e2d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73400baf0 tx=0x7fd73400b3b0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 -- 172.21.15.46:0/1492740932 shutdown_connections 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 --2- 172.21.15.46:0/1492740932 >> v2:172.21.15.162:3300/0 conn(0x7fd74415a0e0 0x7fd7440aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 --2- 172.21.15.46:0/1492740932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd74406e2d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 -- 172.21.15.46:0/1492740932 >> 172.21.15.46:0/1492740932 conn(0x7fd744067750 msgr2=0x7fd74406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 -- 172.21.15.46:0/1492740932 shutdown_connections 2024-08-17T02:28:10.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.820+0000 7fd743200640 1 -- 172.21.15.46:0/1492740932 wait complete. 2024-08-17T02:28:10.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.821+0000 7fd743200640 1 Processor -- start 2024-08-17T02:28:10.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.821+0000 7fd743200640 1 -- start start 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd744155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 0x7fd744168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744157330 con 0x7fd7440aae40 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744156720 con 0x7fd74415a0e0 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd743200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd744156a00 con 0x7fd74406df00 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.822+0000 7fd741400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43406/0 (socket says 172.21.15.46:43406) 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 -- 172.21.15.46:0/3314628884 learned_addr learned my addr 172.21.15.46:0/3314628884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:10.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741e00640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd744155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd742800640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 0x7fd744168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 -- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 msgr2=0x7fd744155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd744155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 -- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 msgr2=0x7fd744168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 0x7fd744168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 -- 172.21.15.46:0/3314628884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73400b630 con 0x7fd7440aae40 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd742800640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 0x7fd744168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:10.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.823+0000 7fd741400640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e900 tx=0x7fd7300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.824+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000c8e0 con 0x7fd7440aae40 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.824+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73000ca40 con 0x7fd7440aae40 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.824+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000cde0 con 0x7fd7440aae40 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.824+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd744156ce0 con 0x7fd7440aae40 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.824+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd744156410 con 0x7fd7440aae40 2024-08-17T02:28:10.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.825+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7441574e0 con 0x7fd7440aae40 2024-08-17T02:28:10.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.826+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd730013680 con 0x7fd7440aae40 2024-08-17T02:28:10.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.827+0000 7fd739600640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 0x7fd724067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:10.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.827+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd730082650 con 0x7fd7440aae40 2024-08-17T02:28:10.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.827+0000 7fd741e00640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 0x7fd724067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:10.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.828+0000 7fd741e00640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 0x7fd724067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd734037000 tx=0x7fd73403a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:10.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:10.830+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7441574e0 con 0x7fd7440aae40 2024-08-17T02:28:11.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.015+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd744071050 con 0x7fd7440aae40 2024-08-17T02:28:11.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.015+0000 7fd739600640 1 -- 172.21.15.46:0/3314628884 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd730050730 con 0x7fd7440aae40 2024-08-17T02:28:11.017 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 msgr2=0x7fd724067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 0x7fd724067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd734037000 tx=0x7fd73403a000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 msgr2=0x7fd744152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e900 tx=0x7fd7300090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 shutdown_connections 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd74415a0e0 0x7fd744168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7440aae40 0x7fd744152f50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd724065150 0x7fd724067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 --2- 172.21.15.46:0/3314628884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd74406df00 0x7fd744155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 >> 172.21.15.46:0/3314628884 conn(0x7fd744067750 msgr2=0x7fd74406e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 shutdown_connections 2024-08-17T02:28:11.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.018+0000 7fd743200640 1 -- 172.21.15.46:0/3314628884 wait complete. 2024-08-17T02:28:11.033 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:11.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.187+0000 7fb40ac00640 1 Processor -- start 2024-08-17T02:28:11.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.187+0000 7fb40ac00640 1 -- start start 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4040ce250 0x7fb4040ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 0x7fb4040b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 0x7fb404158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040c5a40 con 0x7fb4040ce250 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040b2eb0 con 0x7fb4040c4950 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb40ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040c4e30 con 0x7fb4040cb980 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb409800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4040ce250 0x7fb4040ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb409800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb4040ce250 0x7fb4040ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43412/0 (socket says 172.21.15.46:43412) 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.188+0000 7fb409800640 1 -- 172.21.15.46:0/3372167710 learned_addr learned my addr 172.21.15.46:0/3372167710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb40a200640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 0x7fb404158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb408e00640 1 --2- 172.21.15.46:0/3372167710 >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 0x7fb4040b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb409800640 1 -- 172.21.15.46:0/3372167710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 msgr2=0x7fb404158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb409800640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 0x7fb404158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb409800640 1 -- 172.21.15.46:0/3372167710 >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 msgr2=0x7fb4040b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb409800640 1 --2- 172.21.15.46:0/3372167710 >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 0x7fb4040b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb409800640 1 -- 172.21.15.46:0/3372167710 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040c5110 con 0x7fb4040ce250 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb40a200640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 0x7fb404158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.189+0000 7fb408e00640 1 --2- 172.21.15.46:0/3372167710 >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 0x7fb4040b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.190+0000 7fb409800640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040ce250 0x7fb4040ce620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb4040c59b0 tx=0x7fb3f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f43b6f9f058fa0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.190+0000 7fb403e00640 1 -- 172.21.15.46:0/3372167710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f802add0 con 0x7fb4040ce250 2024-08-17T02:28:11.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.190+0000 7fb403e00640 1 -- 172.21.15.46:0/3372167710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8032440 con 0x7fb4040ce250 2024-08-17T02:28:11.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.190+0000 7fb403e00640 1 -- 172.21.15.46:0/3372167710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8032820 con 0x7fb4040ce250 2024-08-17T02:28:11.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 -- 172.21.15.46:0/3372167710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040ce250 msgr2=0x7fb4040ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040ce250 0x7fb4040ce620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb4040c59b0 tx=0x7fb3f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 -- 172.21.15.46:0/3372167710 shutdown_connections 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040cb980 0x7fb404158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 --2- 172.21.15.46:0/3372167710 >> v2:172.21.15.162:3300/0 conn(0x7fb4040c4950 0x7fb4040b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 --2- 172.21.15.46:0/3372167710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040ce250 0x7fb4040ce620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 -- 172.21.15.46:0/3372167710 >> 172.21.15.46:0/3372167710 conn(0x7fb404098e30 msgr2=0x7fb40406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 -- 172.21.15.46:0/3372167710 shutdown_connections 2024-08-17T02:28:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.191+0000 7fb40ac00640 1 -- 172.21.15.46:0/3372167710 wait complete. 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.192+0000 7fb40ac00640 1 Processor -- start 2024-08-17T02:28:11.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.193+0000 7fb40ac00640 1 -- start start 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.193+0000 7fb40ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 0x7fb40409ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.193+0000 7fb40ac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb40ac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040ce250 0x7fb4040c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb40ac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb404151aa0 con 0x7fb4040cb980 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb40ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040c7b60 con 0x7fb4040c4950 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb40ac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040c7e40 con 0x7fb4040ce250 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43418/0 (socket says 172.21.15.46:43418) 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 -- 172.21.15.46:0/1548335964 learned_addr learned my addr 172.21.15.46:0/1548335964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:11.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb409800640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 0x7fb40409ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb40a200640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040ce250 0x7fb4040c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 -- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040ce250 msgr2=0x7fb4040c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040ce250 0x7fb4040c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 -- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 msgr2=0x7fb40409ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 0x7fb40409ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb408e00640 1 -- 172.21.15.46:0/1548335964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009450 con 0x7fb4040cb980 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.194+0000 7fb409800640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 0x7fb40409ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb408e00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000d890 tx=0x7fb3f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000de80 con 0x7fb4040cb980 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000b8d0 con 0x7fb4040cb980 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040c8120 con 0x7fb4040cb980 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000bc90 con 0x7fb4040cb980 2024-08-17T02:28:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.195+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40409b2c0 con 0x7fb4040cb980 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.196+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040c8310 con 0x7fb4040cb980 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.197+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3f001e460 con 0x7fb4040cb980 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.198+0000 7fb400c00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 0x7fb3e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.198+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3f0082a50 con 0x7fb4040cb980 2024-08-17T02:28:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.198+0000 7fb409800640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 0x7fb3e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.199+0000 7fb409800640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 0x7fb3e4067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034000 tx=0x7fb3f8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.202+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3f0050b20 con 0x7fb4040cb980 2024-08-17T02:28:11.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.384+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4040c8510 con 0x7fb4040cb980 2024-08-17T02:28:11.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.385+0000 7fb400c00640 1 -- 172.21.15.46:0/1548335964 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3f0054140 con 0x7fb4040cb980 2024-08-17T02:28:11.386 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 msgr2=0x7fb3e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 0x7fb3e4067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034000 tx=0x7fb3f8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 msgr2=0x7fb40413da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000d890 tx=0x7fb3f0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 shutdown_connections 2024-08-17T02:28:11.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb3e4065150 0x7fb3e4067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4040ce250 0x7fb4040c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4040cb980 0x7fb40413da70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 --2- 172.21.15.46:0/1548335964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4040c4950 0x7fb40409ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 >> 172.21.15.46:0/1548335964 conn(0x7fb404098e30 msgr2=0x7fb404154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 shutdown_connections 2024-08-17T02:28:11.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.387+0000 7fb40ac00640 1 -- 172.21.15.46:0/1548335964 wait complete. 2024-08-17T02:28:11.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.558+0000 7f2244600640 1 Processor -- start 2024-08-17T02:28:11.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.558+0000 7f2244600640 1 -- start start 2024-08-17T02:28:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.559+0000 7f2244600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f223c155a80 0x7f223c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.559+0000 7f2244600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f223c0c7db0 0x7f223c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.559+0000 7f2244600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c1598f0 con 0x7f223c155e50 2024-08-17T02:28:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.559+0000 7f2244600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c159bd0 con 0x7f223c155a80 2024-08-17T02:28:11.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.559+0000 7f2244600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c159eb0 con 0x7f223c0c7db0 2024-08-17T02:28:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f223c155a80 0x7f223c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f223c155a80 0x7f223c06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43420/0 (socket says 172.21.15.46:43420) 2024-08-17T02:28:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 -- 172.21.15.46:0/606911654 learned_addr learned my addr 172.21.15.46:0/606911654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:11.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241200640 1 --2- 172.21.15.46:0/606911654 >> v2:172.21.15.162:3300/0 conn(0x7f223c0c7db0 0x7f223c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 -- 172.21.15.46:0/606911654 >> v2:172.21.15.162:3300/0 conn(0x7f223c0c7db0 msgr2=0x7f223c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 --2- 172.21.15.46:0/606911654 >> v2:172.21.15.162:3300/0 conn(0x7f223c0c7db0 0x7f223c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 -- 172.21.15.46:0/606911654 >> v1:172.21.15.162:6789/0 conn(0x7f223c155e50 legacy=0x7f223c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.560+0000 7f2241c00640 1 -- 172.21.15.46:0/606911654 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15a190 con 0x7f223c155a80 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.561+0000 7f2241c00640 1 --2- 172.21.15.46:0/606911654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c155a80 0x7f223c06dc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f223c06c750 tx=0x7f22300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48df0d573483852 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.561+0000 7f223be00640 1 -- 172.21.15.46:0/606911654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230032440 con 0x7f223c155a80 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f223be00640 1 -- 172.21.15.46:0/606911654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22300325a0 con 0x7f223c155a80 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f223be00640 1 -- 172.21.15.46:0/606911654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230032980 con 0x7f223c155a80 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 -- 172.21.15.46:0/606911654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c155a80 msgr2=0x7f223c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 --2- 172.21.15.46:0/606911654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c155a80 0x7f223c06dc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f223c06c750 tx=0x7f22300091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 -- 172.21.15.46:0/606911654 shutdown_connections 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 --2- 172.21.15.46:0/606911654 >> v2:172.21.15.162:3300/0 conn(0x7f223c0c7db0 0x7f223c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 --2- 172.21.15.46:0/606911654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c155a80 0x7f223c06dc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 -- 172.21.15.46:0/606911654 >> 172.21.15.46:0/606911654 conn(0x7f223c067750 msgr2=0x7f223c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 -- 172.21.15.46:0/606911654 shutdown_connections 2024-08-17T02:28:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.562+0000 7f2244600640 1 -- 172.21.15.46:0/606911654 wait complete. 2024-08-17T02:28:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.564+0000 7f2244600640 1 Processor -- start 2024-08-17T02:28:11.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.564+0000 7f2244600640 1 -- start start 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f223c155a80 0x7f223c149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 0x7f223c0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15c440 con 0x7f223c0c7db0 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c1576a0 con 0x7f223c155e50 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2244600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c158cb0 con 0x7f223c155a80 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43426/0 (socket says 172.21.15.46:43426) 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 -- 172.21.15.46:0/2761913123 learned_addr learned my addr 172.21.15.46:0/2761913123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241200640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f223c155a80 0x7f223c149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2242600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 0x7f223c0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 -- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f223c155a80 msgr2=0x7f223c149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f223c155a80 0x7f223c149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 -- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 msgr2=0x7f223c0a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 0x7f223c0a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2241c00640 1 -- 172.21.15.46:0/2761913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009450 con 0x7f223c0c7db0 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.565+0000 7f2242600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 0x7f223c0a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2241c00640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2230009940 tx=0x7f2230032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230031b30 con 0x7f223c0c7db0 2024-08-17T02:28:11.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230031cb0 con 0x7f223c0c7db0 2024-08-17T02:28:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223003d670 con 0x7f223c0c7db0 2024-08-17T02:28:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c1580a0 con 0x7f223c0c7db0 2024-08-17T02:28:11.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.566+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c158660 con 0x7f223c0c7db0 2024-08-17T02:28:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.567+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c071050 con 0x7f223c0c7db0 2024-08-17T02:28:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.568+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2230039040 con 0x7f223c0c7db0 2024-08-17T02:28:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.569+0000 7f2238c00640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 0x7f221c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.569+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22300a2500 con 0x7f223c0c7db0 2024-08-17T02:28:11.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.569+0000 7f2241200640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 0x7f221c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.570+0000 7f2241200640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 0x7f221c067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f223c0b0680 tx=0x7f22280090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.573+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22300705d0 con 0x7f223c0c7db0 2024-08-17T02:28:11.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.757+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f223c06aa10 con 0x7f223c0c7db0 2024-08-17T02:28:11.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.758+0000 7f2238c00640 1 -- 172.21.15.46:0/2761913123 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2230079020 con 0x7f223c0c7db0 2024-08-17T02:28:11.759 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 msgr2=0x7f221c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 0x7f221c067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f223c0b0680 tx=0x7f22280090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 msgr2=0x7f223c157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2230009940 tx=0x7f2230032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 shutdown_connections 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f223c155e50 0x7f223c0a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f221c065150 0x7f221c067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f223c155a80 0x7f223c149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 --2- 172.21.15.46:0/2761913123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f223c0c7db0 0x7f223c157160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 >> 172.21.15.46:0/2761913123 conn(0x7f223c067750 msgr2=0x7f223c0ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 shutdown_connections 2024-08-17T02:28:11.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.760+0000 7f2244600640 1 -- 172.21.15.46:0/2761913123 wait complete. 2024-08-17T02:28:11.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:28:11.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.927+0000 7f4546800640 1 Processor -- start 2024-08-17T02:28:11.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.927+0000 7f4546800640 1 -- start start 2024-08-17T02:28:11.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f4546800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 0x7f45400c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f4546800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400cb7c0 con 0x7f4540158ce0 2024-08-17T02:28:11.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f4546800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400ceb20 con 0x7f45400cb340 2024-08-17T02:28:11.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f4546800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400cf0c0 con 0x7f45400d08d0 2024-08-17T02:28:11.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f453f400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4540158ce0 0x7f45400cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44972/0 (socket says 172.21.15.46:44972) 2024-08-17T02:28:11.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f453f400640 1 -- 172.21.15.46:0/1276356852 learned_addr learned my addr 172.21.15.46:0/1276356852 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:11.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.928+0000 7f4537e00640 1 --2- 172.21.15.46:0/1276356852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 0x7f45400c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830500296 0 0) 0x7f45400cb7c0 con 0x7f4540158ce0 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45240034e0 con 0x7f4540158ce0 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876292347 0 0) 0x7f45400ceb20 con 0x7f45400cb340 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45400cb7c0 con 0x7f45400cb340 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f4537e00640 1 -- 172.21.15.46:0/1276356852 >> v1:172.21.15.162:6789/0 conn(0x7f45400cb340 legacy=0x7f45400c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f4537e00640 1 -- 172.21.15.46:0/1276356852 >> v1:172.21.15.46:6789/0 conn(0x7f4540158ce0 legacy=0x7f45400cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.929+0000 7f4537e00640 1 -- 172.21.15.46:0/1276356852 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400cede0 con 0x7f45400d08d0 2024-08-17T02:28:11.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.930+0000 7f4537e00640 1 --2- 172.21.15.46:0/1276356852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 0x7f45400c68c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4528009880 tx=0x7f45280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3650cbdf0bd5c11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.930+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802ae10 con 0x7f45400d08d0 2024-08-17T02:28:11.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.930+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528032440 con 0x7f45400d08d0 2024-08-17T02:28:11.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.930+0000 7f453ea00640 1 -- 172.21.15.46:0/1276356852 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280327e0 con 0x7f45400d08d0 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 -- 172.21.15.46:0/1276356852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 msgr2=0x7f45400c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 --2- 172.21.15.46:0/1276356852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 0x7f45400c68c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4528009880 tx=0x7f45280090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 -- 172.21.15.46:0/1276356852 shutdown_connections 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 --2- 172.21.15.46:0/1276356852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400d08d0 0x7f45400c68c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 -- 172.21.15.46:0/1276356852 >> 172.21.15.46:0/1276356852 conn(0x7f45400cfdc0 msgr2=0x7f45400d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 -- 172.21.15.46:0/1276356852 shutdown_connections 2024-08-17T02:28:11.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.931+0000 7f4546800640 1 -- 172.21.15.46:0/1276356852 wait complete. 2024-08-17T02:28:11.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.932+0000 7f4546800640 1 Processor -- start 2024-08-17T02:28:11.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 -- start start 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400cb340 0x7f45401477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 0x7f45400b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4540169d70 con 0x7f45400d08d0 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b2c00 con 0x7f4540158ce0 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.933+0000 7f4546800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400b2ee0 con 0x7f45400cb340 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43430/0 (socket says 172.21.15.46:43430) 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 -- 172.21.15.46:0/2414807510 learned_addr learned my addr 172.21.15.46:0/2414807510 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f453fe00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 0x7f45400b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f453f400640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400cb340 0x7f45401477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 -- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400cb340 msgr2=0x7f45401477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400cb340 0x7f45401477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 -- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 msgr2=0x7f45400b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 0x7f45400b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f4537e00640 1 -- 172.21.15.46:0/2414807510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528009390 con 0x7f45400d08d0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.934+0000 7f453fe00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 0x7f45400b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4537e00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4528009880 tx=0x7f4528032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528000c40 con 0x7f45400d08d0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4528031a60 con 0x7f45400d08d0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4528031e20 con 0x7f45400d08d0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400b31c0 con 0x7f45400d08d0 2024-08-17T02:28:11.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.935+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4540147d00 con 0x7f45400d08d0 2024-08-17T02:28:11.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.936+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400b3020 con 0x7f45400d08d0 2024-08-17T02:28:11.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.937+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4528039040 con 0x7f45400d08d0 2024-08-17T02:28:11.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.937+0000 7f4536a00640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.938+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45280a1fd0 con 0x7f45400d08d0 2024-08-17T02:28:11.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.938+0000 7f453f400640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.939+0000 7f453f400640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 0x7f451c067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4530005840 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:11.941+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45400b3020 con 0x7f45400d08d0 2024-08-17T02:28:12.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.193+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f45400b3020 con 0x7f45400d08d0 2024-08-17T02:28:12.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.338+0000 7f4536a00640 1 -- 172.21.15.46:0/2414807510 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45400b3020 con 0x7f45400d08d0 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 msgr2=0x7f451c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 0x7f451c067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4530005840 tx=0x7f4530009040 comp rx=0 tx=0).stop 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 msgr2=0x7f45400b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4528009880 tx=0x7f4528032000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 shutdown_connections 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4540158ce0 0x7f45400b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45400d08d0 0x7f45400b39c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f451c065150 0x7f451c067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 --2- 172.21.15.46:0/2414807510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45400cb340 0x7f45401477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 >> 172.21.15.46:0/2414807510 conn(0x7f45400cfdc0 msgr2=0x7f4540155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 shutdown_connections 2024-08-17T02:28:12.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.340+0000 7f4546800640 1 -- 172.21.15.46:0/2414807510 wait complete. 2024-08-17T02:28:12.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:12.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.509+0000 7ff02cc00640 1 Processor -- start 2024-08-17T02:28:12.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.509+0000 7ff02cc00640 1 -- start start 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff02cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff02815c2f0 0x7ff0280af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff02cc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280af910 con 0x7ff0280d0890 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff02cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280afbb0 con 0x7ff0280b0f20 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff02cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280b1e10 con 0x7ff02815c2f0 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff025400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff0280d0890 0x7ff0280b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44978/0 (socket says 172.21.15.46:44978) 2024-08-17T02:28:12.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.510+0000 7ff025400640 1 -- 172.21.15.46:0/3354108331 learned_addr learned my addr 172.21.15.46:0/3354108331 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff025e00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff02815c2f0 0x7ff0280af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335226810 0 0) 0x7ff0280af910 con 0x7ff0280d0890 2024-08-17T02:28:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff00c0034e0 con 0x7ff0280d0890 2024-08-17T02:28:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356477468 0 0) 0x7ff0280afbb0 con 0x7ff0280b0f20 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0280af910 con 0x7ff0280b0f20 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121874622 0 0) 0x7ff00c0034e0 con 0x7ff0280d0890 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff02815c2f0 msgr2=0x7ff0280af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff02815c2f0 0x7ff0280af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 >> v1:172.21.15.162:6789/0 conn(0x7ff0280b0f20 legacy=0x7ff0280b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280afe90 con 0x7ff0280d0890 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7ff014001470 con 0x7ff0280d0890 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 >> v1:172.21.15.46:6789/0 conn(0x7ff0280d0890 legacy=0x7ff0280b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c003b90 0x7ff00c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff00c004780 0x7ff00c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff00c005130 0x7ff00c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280b1e10 con 0x7ff00c004780 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c00bff0 con 0x7ff00c005130 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.511+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c00c1b0 con 0x7ff00c003b90 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff00c004780 0x7ff00c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025e00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c003b90 0x7ff00c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff026800640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff00c005130 0x7ff00c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 -- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c003b90 msgr2=0x7ff00c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c003b90 0x7ff00c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 -- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff00c005130 msgr2=0x7ff00c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff00c005130 0x7ff00c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff025400640 1 -- 172.21.15.46:0/3354108331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c0034e0 con 0x7ff00c004780 2024-08-17T02:28:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.512+0000 7ff026800640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff00c005130 0x7ff00c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.513+0000 7ff025400640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff00c004780 0x7ff00c004bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c190 tx=0x7ff014001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca312b799b79e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.513+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014005960 con 0x7ff00c004780 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.513+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01402d070 con 0x7ff00c004780 2024-08-17T02:28:12.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.513+0000 7ff024a00640 1 -- 172.21.15.46:0/3354108331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014005b20 con 0x7ff00c004780 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 -- 172.21.15.46:0/3354108331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff00c004780 msgr2=0x7ff00c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 --2- 172.21.15.46:0/3354108331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff00c004780 0x7ff00c004bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff01400c190 tx=0x7ff014001d40 comp rx=0 tx=0).stop 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff026800640 1 -- 172.21.15.46:0/3354108331 reap_dead start 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 -- 172.21.15.46:0/3354108331 shutdown_connections 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 -- 172.21.15.46:0/3354108331 >> 172.21.15.46:0/3354108331 conn(0x7ff0280cfdb0 msgr2=0x7ff0280d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 -- 172.21.15.46:0/3354108331 shutdown_connections 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.514+0000 7ff02cc00640 1 -- 172.21.15.46:0/3354108331 wait complete. 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.515+0000 7ff02cc00640 1 Processor -- start 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.515+0000 7ff02cc00640 1 -- start start 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c004780 0x7ff028169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0280cce40 0x7ff0280ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280ce790 con 0x7ff0280cec20 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280cde60 con 0x7ff0280cce40 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff02cc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280ce140 con 0x7ff00c004780 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff025400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff025400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43446/0 (socket says 172.21.15.46:43446) 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.516+0000 7ff025400640 1 -- 172.21.15.46:0/2069607020 learned_addr learned my addr 172.21.15.46:0/2069607020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025e00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c004780 0x7ff028169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff026800640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0280cce40 0x7ff0280ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 -- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c004780 msgr2=0x7ff028169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c004780 0x7ff028169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 -- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0280cce40 msgr2=0x7ff0280ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0280cce40 0x7ff0280ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 -- 172.21.15.46:0/2069607020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280ce420 con 0x7ff0280cec20 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff025400640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff014001da0 tx=0x7ff014033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014007280 con 0x7ff0280cec20 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0140073e0 con 0x7ff0280cec20 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02816a290 con 0x7ff0280cec20 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.517+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014032430 con 0x7ff0280cec20 2024-08-17T02:28:12.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.518+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0280cf230 con 0x7ff0280cec20 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.519+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02816a420 con 0x7ff0280cec20 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.519+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff01402f030 con 0x7ff0280cec20 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.520+0000 7ff01d600640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 0x7ff008067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.520+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0140a1fe0 con 0x7ff0280cec20 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.521+0000 7ff025e00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 0x7ff008067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.521+0000 7ff025e00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 0x7ff008067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff018009360 tx=0x7ff018008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.524+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0140700b0 con 0x7ff0280cec20 2024-08-17T02:28:12.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.704+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff0280ce5b0 con 0x7ff0280cec20 2024-08-17T02:28:12.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.708+0000 7ff01d600640 1 -- 172.21.15.46:0/2069607020 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0140736d0 con 0x7ff0280cec20 2024-08-17T02:28:12.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 msgr2=0x7ff008067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 0x7ff008067630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff018009360 tx=0x7ff018008040 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 msgr2=0x7ff0280cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff014001da0 tx=0x7ff014033000 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 shutdown_connections 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0280cce40 0x7ff0280ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0280cec20 0x7ff0280cc900 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff008065180 0x7ff008067630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 --2- 172.21.15.46:0/2069607020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff00c004780 0x7ff028169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.710+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 >> 172.21.15.46:0/2069607020 conn(0x7ff0280cfdb0 msgr2=0x7ff02815b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.711+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 shutdown_connections 2024-08-17T02:28:12.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:12.711+0000 7ff02cc00640 1 -- 172.21.15.46:0/2069607020 wait complete. 2024-08-17T02:28:12.727 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:28:12.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:12.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:12.933 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:12.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:28:12.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:12.934 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:28:12.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:28:12.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.996 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:13.045 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:28:13.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:13.045 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:28:13.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:28:13.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:13.110 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:13.159 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:28:13.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:13.160 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:28:13.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:28:13.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:13.219 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:28:13.255 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:28:13.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:13.256 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:28:13.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:28:13.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:13.317 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:28:13.353 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:28:13.353 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:13.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.503+0000 7faf41000640 1 Processor -- start 2024-08-17T02:28:13.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.504+0000 7faf41000640 1 -- start start 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf41000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0cbea0 0x7faf3c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf41000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf3c06dc80 0x7faf3c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf41000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cc2d0 con 0x7faf3c156ad0 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf41000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0ca900 con 0x7faf3c06dc80 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf41000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0cc560 con 0x7faf3c0cbea0 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf3be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf3c06dc80 0x7faf3c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf3b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7faf3c156ad0 0x7faf3c06d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:59946/0 (socket says 172.21.15.46:59946) 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf3b400640 1 -- 172.21.15.46:0/1636907719 learned_addr learned my addr 172.21.15.46:0/1636907719 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:13.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.505+0000 7faf33e00640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0cbea0 0x7faf3c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.506+0000 7faf3aa00640 1 -- 172.21.15.46:0/1636907719 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397066059 0 0) 0x7faf3c0cc2d0 con 0x7faf3c156ad0 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.506+0000 7faf3be00640 1 -- 172.21.15.46:0/1636907719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0cbea0 msgr2=0x7faf3c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.506+0000 7faf3be00640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0cbea0 0x7faf3c156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.506+0000 7faf3be00640 1 -- 172.21.15.46:0/1636907719 >> v1:172.21.15.162:6789/0 conn(0x7faf3c156ad0 legacy=0x7faf3c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.506+0000 7faf3be00640 1 -- 172.21.15.46:0/1636907719 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0caaf0 con 0x7faf3c06dc80 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf3be00640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c06dc80 0x7faf3c1577f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf34009e90 tx=0x7faf34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07b98ea22fdaa0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf3aa00640 1 -- 172.21.15.46:0/1636907719 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34007550 con 0x7faf3c06dc80 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf3aa00640 1 -- 172.21.15.46:0/1636907719 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3402d050 con 0x7faf3c06dc80 2024-08-17T02:28:13.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf3aa00640 1 -- 172.21.15.46:0/1636907719 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf340078e0 con 0x7faf3c06dc80 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 -- 172.21.15.46:0/1636907719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c06dc80 msgr2=0x7faf3c1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c06dc80 0x7faf3c1577f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faf34009e90 tx=0x7faf34009780 comp rx=0 tx=0).stop 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 -- 172.21.15.46:0/1636907719 shutdown_connections 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c06dc80 0x7faf3c1577f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 --2- 172.21.15.46:0/1636907719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0cbea0 0x7faf3c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.507+0000 7faf41000640 1 -- 172.21.15.46:0/1636907719 >> 172.21.15.46:0/1636907719 conn(0x7faf3c067750 msgr2=0x7faf3c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.508+0000 7faf41000640 1 -- 172.21.15.46:0/1636907719 shutdown_connections 2024-08-17T02:28:13.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.508+0000 7faf41000640 1 -- 172.21.15.46:0/1636907719 wait complete. 2024-08-17T02:28:13.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.509+0000 7faf41000640 1 Processor -- start 2024-08-17T02:28:13.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.509+0000 7faf41000640 1 -- start start 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c06dc80 0x7faf3c146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c156ad0 0x7faf3c0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0a9670 con 0x7faf3c0cbea0 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c147100 con 0x7faf3c06dc80 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf41000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0a6f60 con 0x7faf3c156ad0 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf33e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf33e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43450/0 (socket says 172.21.15.46:43450) 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf33e00640 1 -- 172.21.15.46:0/4095941237 learned_addr learned my addr 172.21.15.46:0/4095941237 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf3b400640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c06dc80 0x7faf3c146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.510+0000 7faf3be00640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c156ad0 0x7faf3c0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 -- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c156ad0 msgr2=0x7faf3c0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c156ad0 0x7faf3c0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 -- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c06dc80 msgr2=0x7faf3c146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c06dc80 0x7faf3c146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 -- 172.21.15.46:0/4095941237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34009a20 con 0x7faf3c0cbea0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf33e00640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf2400ea20 tx=0x7faf240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400c9b0 con 0x7faf3c0cbea0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400cb10 con 0x7faf3c0cbea0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400ce90 con 0x7faf3c0cbea0 2024-08-17T02:28:13.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0a6320 con 0x7faf3c0cbea0 2024-08-17T02:28:13.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.511+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0a68e0 con 0x7faf3c0cbea0 2024-08-17T02:28:13.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.513+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c0a7110 con 0x7faf3c0cbea0 2024-08-17T02:28:13.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.513+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf24013680 con 0x7faf3c0cbea0 2024-08-17T02:28:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.514+0000 7faf32a00640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 0x7faf18067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.514+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf240826b0 con 0x7faf3c0cbea0 2024-08-17T02:28:13.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.515+0000 7faf3b400640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 0x7faf18067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.515+0000 7faf3b400640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 0x7faf18067630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0c7e80 tx=0x7faf2c007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.518+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faf3c0a7110 con 0x7faf3c0cbea0 2024-08-17T02:28:13.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.589 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.739+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf3c0a70d0 con 0x7faf3c0cbea0 2024-08-17T02:28:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.740+0000 7faf32a00640 1 -- 172.21.15.46:0/4095941237 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7faf24050780 con 0x7faf3c0cbea0 2024-08-17T02:28:13.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:13.741 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:13.741 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:28:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 msgr2=0x7faf18067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 0x7faf18067630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0c7e80 tx=0x7faf2c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 msgr2=0x7faf3c0a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf2400ea20 tx=0x7faf240090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 shutdown_connections 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf18065180 0x7faf18067630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c156ad0 0x7faf3c0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf3c0cbea0 0x7faf3c0a8bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 --2- 172.21.15.46:0/4095941237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c06dc80 0x7faf3c146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 >> 172.21.15.46:0/4095941237 conn(0x7faf3c067750 msgr2=0x7faf3c069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 shutdown_connections 2024-08-17T02:28:13.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.742+0000 7faf41000640 1 -- 172.21.15.46:0/4095941237 wait complete. 2024-08-17T02:28:13.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.909+0000 7fd7cae00640 1 Processor -- start 2024-08-17T02:28:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.910+0000 7fd7cae00640 1 -- start start 2024-08-17T02:28:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7cae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7cae00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7c4155df0 0x7fd7c40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7cae00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c4156670 con 0x7fd7c406d7f0 2024-08-17T02:28:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7cae00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c40b0350 con 0x7fd7c4155df0 2024-08-17T02:28:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7cae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c406e5e0 con 0x7fd7c4155a20 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7c8e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd7c406d7f0 0x7fd7c40ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44980/0 (socket says 172.21.15.46:44980) 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7c8e00640 1 -- 172.21.15.46:0/4187270796 learned_addr learned my addr 172.21.15.46:0/4187270796 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/4187270796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.911+0000 7fd7bbe00640 1 --2- 172.21.15.46:0/4187270796 >> v2:172.21.15.162:3300/0 conn(0x7fd7c4155df0 0x7fd7c40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.912+0000 7fd7c3e00640 1 -- 172.21.15.46:0/4187270796 >> v2:172.21.15.162:3300/0 conn(0x7fd7c4155df0 msgr2=0x7fd7c40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.912+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/4187270796 >> v2:172.21.15.162:3300/0 conn(0x7fd7c4155df0 0x7fd7c40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.912+0000 7fd7c3e00640 1 -- 172.21.15.46:0/4187270796 >> v1:172.21.15.46:6789/0 conn(0x7fd7c406d7f0 legacy=0x7fd7c40ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.912+0000 7fd7c3e00640 1 -- 172.21.15.46:0/4187270796 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c406e8c0 con 0x7fd7c4155a20 2024-08-17T02:28:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.912+0000 7fd7c3400640 1 -- 172.21.15.46:0/4187270796 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011539199 0 0) 0x7fd7c4156670 con 0x7fd7c406d7f0 2024-08-17T02:28:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/4187270796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c40adf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009850 tx=0x7fd7b40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648234d0aeaba51c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7c3400640 1 -- 172.21.15.46:0/4187270796 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b402ad80 con 0x7fd7c4155a20 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7c3400640 1 -- 172.21.15.46:0/4187270796 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b4032440 con 0x7fd7c4155a20 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7c3400640 1 -- 172.21.15.46:0/4187270796 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40327e0 con 0x7fd7c4155a20 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7cae00640 1 -- 172.21.15.46:0/4187270796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 msgr2=0x7fd7c40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.913+0000 7fd7cae00640 1 --2- 172.21.15.46:0/4187270796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c40adf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009850 tx=0x7fd7b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 -- 172.21.15.46:0/4187270796 shutdown_connections 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 --2- 172.21.15.46:0/4187270796 >> v2:172.21.15.162:3300/0 conn(0x7fd7c4155df0 0x7fd7c40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 --2- 172.21.15.46:0/4187270796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c40adf10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 -- 172.21.15.46:0/4187270796 >> 172.21.15.46:0/4187270796 conn(0x7fd7c40cb9b0 msgr2=0x7fd7c40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 -- 172.21.15.46:0/4187270796 shutdown_connections 2024-08-17T02:28:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.914+0000 7fd7cae00640 1 -- 172.21.15.46:0/4187270796 wait complete. 2024-08-17T02:28:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.915+0000 7fd7cae00640 1 Processor -- start 2024-08-17T02:28:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.915+0000 7fd7cae00640 1 -- start start 2024-08-17T02:28:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 0x7fd7c40ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c4142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40a7980 con 0x7fd7c4155df0 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40a7c60 con 0x7fd7c406d7f0 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7cae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40a7f40 con 0x7fd7c4155a20 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7c8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7c8e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43460/0 (socket says 172.21.15.46:43460) 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7c8e00640 1 -- 172.21.15.46:0/1803345309 learned_addr learned my addr 172.21.15.46:0/1803345309 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.916+0000 7fd7bbe00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c4142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 0x7fd7c40ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 -- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 msgr2=0x7fd7c4142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c4142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 -- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 msgr2=0x7fd7c40ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 0x7fd7c40ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 -- 172.21.15.46:0/1803345309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009390 con 0x7fd7c4155df0 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 0x7fd7c40ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7c8e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00cc90 tx=0x7fd7bc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00a850 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00a9b0 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c40a8220 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00ad70 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.917+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c40aca10 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.918+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4064db0 con 0x7fd7c4155df0 2024-08-17T02:28:13.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.919+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd7bc007300 con 0x7fd7c4155df0 2024-08-17T02:28:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.920+0000 7fd7bb400640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 0x7fd7a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.920+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7bc082570 con 0x7fd7c4155df0 2024-08-17T02:28:13.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.921+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 0x7fd7a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.921+0000 7fd7c3e00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 0x7fd7a0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4034000 tx=0x7fd7b4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:13.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:13.924+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd7bc050610 con 0x7fd7c4155df0 2024-08-17T02:28:14.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.106+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c40af1e0 con 0x7fd7c4155df0 2024-08-17T02:28:14.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.107+0000 7fd7bb400640 1 -- 172.21.15.46:0/1803345309 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd7bc053c30 con 0x7fd7c4155df0 2024-08-17T02:28:14.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:14.108 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 msgr2=0x7fd7a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 0x7fd7a0067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4034000 tx=0x7fd7b4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 msgr2=0x7fd7c4142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00cc90 tx=0x7fd7bc001a20 comp rx=0 tx=0).stop 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 shutdown_connections 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7c4155df0 0x7fd7c4142550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd7a0065150 0x7fd7a0067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c4155a20 0x7fd7c4142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 --2- 172.21.15.46:0/1803345309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c406d7f0 0x7fd7c40ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 >> 172.21.15.46:0/1803345309 conn(0x7fd7c40cb9b0 msgr2=0x7fd7c41573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 shutdown_connections 2024-08-17T02:28:14.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.109+0000 7fd7cae00640 1 -- 172.21.15.46:0/1803345309 wait complete. 2024-08-17T02:28:14.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:36.821962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:37.622480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:14.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:14.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.279+0000 7fb895a00640 1 Processor -- start 2024-08-17T02:28:14.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.279+0000 7fb895a00640 1 -- start start 2024-08-17T02:28:14.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb895a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb8900b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb895a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8900afd90 0x7fb890157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb895a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900ae540 con 0x7fb890159610 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb895a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900ad930 con 0x7fb8900afd90 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb895a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900adc10 con 0x7fb8900accf0 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb88f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8900afd90 0x7fb890157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb88f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb8900afd90 0x7fb890157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43468/0 (socket says 172.21.15.46:43468) 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb88f400640 1 -- 172.21.15.46:0/1296092193 learned_addr learned my addr 172.21.15.46:0/1296092193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.280+0000 7fb88ea00640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb8900b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.281+0000 7fb88f400640 1 -- 172.21.15.46:0/1296092193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 msgr2=0x7fb8900b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.281+0000 7fb88f400640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb8900b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.281+0000 7fb88f400640 1 -- 172.21.15.46:0/1296092193 >> v1:172.21.15.46:6789/0 conn(0x7fb890159610 legacy=0x7fb8900af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.281+0000 7fb88f400640 1 -- 172.21.15.46:0/1296092193 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900adef0 con 0x7fb8900afd90 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.282+0000 7fb88f400640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8900afd90 0x7fb890157690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb888009f20 tx=0x7fb888009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1b06f34a601159 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.282+0000 7fb88e000640 1 -- 172.21.15.46:0/1296092193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888031400 con 0x7fb8900afd90 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.282+0000 7fb88e000640 1 -- 172.21.15.46:0/1296092193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88802d050 con 0x7fb8900afd90 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.282+0000 7fb88e000640 1 -- 172.21.15.46:0/1296092193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880317d0 con 0x7fb8900afd90 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 -- 172.21.15.46:0/1296092193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8900afd90 msgr2=0x7fb890157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8900afd90 0x7fb890157690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb888009f20 tx=0x7fb888009840 comp rx=0 tx=0).stop 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 -- 172.21.15.46:0/1296092193 shutdown_connections 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb8900afd90 0x7fb890157690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 --2- 172.21.15.46:0/1296092193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb8900b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 -- 172.21.15.46:0/1296092193 >> 172.21.15.46:0/1296092193 conn(0x7fb890067750 msgr2=0x7fb8900cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 -- 172.21.15.46:0/1296092193 shutdown_connections 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.283+0000 7fb895a00640 1 -- 172.21.15.46:0/1296092193 wait complete. 2024-08-17T02:28:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.284+0000 7fb895a00640 1 Processor -- start 2024-08-17T02:28:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.284+0000 7fb895a00640 1 -- start start 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb890159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 0x7fb89014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89016c790 con 0x7fb890159610 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890169690 con 0x7fb8900afd90 2024-08-17T02:28:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb895a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb890169970 con 0x7fb8900accf0 2024-08-17T02:28:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.285+0000 7fb88f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43482/0 (socket says 172.21.15.46:43482) 2024-08-17T02:28:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 -- 172.21.15.46:0/2791521418 learned_addr learned my addr 172.21.15.46:0/2791521418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88ea00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb890159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb887e00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 0x7fb89014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 -- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 msgr2=0x7fb890159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb890159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 -- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 msgr2=0x7fb89014e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 0x7fb89014e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 -- 172.21.15.46:0/2791521418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888009ae0 con 0x7fb890159610 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb887e00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 0x7fb89014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.286+0000 7fb88f400640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb888009f80 tx=0x7fb888036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.287+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888008e50 con 0x7fb890159610 2024-08-17T02:28:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.287+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88803b410 con 0x7fb890159610 2024-08-17T02:28:14.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.287+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88803b7d0 con 0x7fb890159610 2024-08-17T02:28:14.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.287+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb890169c50 con 0x7fb890159610 2024-08-17T02:28:14.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.287+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89015b2e0 con 0x7fb890159610 2024-08-17T02:28:14.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.288+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb890064db0 con 0x7fb890159610 2024-08-17T02:28:14.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.289+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb888038050 con 0x7fb890159610 2024-08-17T02:28:14.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.289+0000 7fb886000640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 0x7fb86c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.290+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8880a3070 con 0x7fb890159610 2024-08-17T02:28:14.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.290+0000 7fb88ea00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 0x7fb86c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.290+0000 7fb88ea00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 0x7fb86c067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb880009cb0 tx=0x7fb880008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.293+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb8880d4e40 con 0x7fb890159610 2024-08-17T02:28:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.476+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8900cc480 con 0x7fb890159610 2024-08-17T02:28:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.476+0000 7fb886000640 1 -- 172.21.15.46:0/2791521418 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb888049020 con 0x7fb890159610 2024-08-17T02:28:14.477 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 msgr2=0x7fb86c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 0x7fb86c067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb880009cb0 tx=0x7fb880008040 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 msgr2=0x7fb89014dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb888009f80 tx=0x7fb888036000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 shutdown_connections 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb890159610 0x7fb89014dbd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8900afd90 0x7fb89014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb86c065150 0x7fb86c067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 --2- 172.21.15.46:0/2791521418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8900accf0 0x7fb890159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.478+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 >> 172.21.15.46:0/2791521418 conn(0x7fb890067750 msgr2=0x7fb890069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.479+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 shutdown_connections 2024-08-17T02:28:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.479+0000 7fb895a00640 1 -- 172.21.15.46:0/2791521418 wait complete. 2024-08-17T02:28:14.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.648+0000 7fc673c00640 1 Processor -- start 2024-08-17T02:28:14.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.648+0000 7fc673c00640 1 -- start start 2024-08-17T02:28:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.649+0000 7fc673c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc66c156c50 0x7fc66c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc673c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc66c0adcf0 0x7fc66c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc673c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc673c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c0ab130 con 0x7fc66c156c50 2024-08-17T02:28:14.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc673c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c0ae5a0 con 0x7fc66c0adcf0 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc673c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c0ae2c0 con 0x7fc66c0abb00 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc66c156c50 0x7fc66c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc66c156c50 0x7fc66c0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43492/0 (socket says 172.21.15.46:43492) 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 -- 172.21.15.46:0/3794479154 learned_addr learned my addr 172.21.15.46:0/3794479154 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc66be00640 1 --2- 172.21.15.46:0/3794479154 >> v2:172.21.15.162:3300/0 conn(0x7fc66c0adcf0 0x7fc66c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671c00640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 -- 172.21.15.46:0/3794479154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 msgr2=0x7fc66c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 -- 172.21.15.46:0/3794479154 >> v2:172.21.15.162:3300/0 conn(0x7fc66c0adcf0 msgr2=0x7fc66c0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 --2- 172.21.15.46:0/3794479154 >> v2:172.21.15.162:3300/0 conn(0x7fc66c0adcf0 0x7fc66c0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671200640 1 -- 172.21.15.46:0/3794479154 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c0aaae0 con 0x7fc66c156c50 2024-08-17T02:28:14.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.650+0000 7fc671c00640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.651+0000 7fc671200640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c0c7cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc66c06f0c0 tx=0x7fc6600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9112b79484a3a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc66b400640 1 -- 172.21.15.46:0/3794479154 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66002acb0 con 0x7fc66c156c50 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc66b400640 1 -- 172.21.15.46:0/3794479154 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66002ae10 con 0x7fc66c156c50 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc66b400640 1 -- 172.21.15.46:0/3794479154 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660032670 con 0x7fc66c156c50 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 -- 172.21.15.46:0/3794479154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 msgr2=0x7fc66c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c0c7cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc66c06f0c0 tx=0x7fc6600091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 -- 172.21.15.46:0/3794479154 shutdown_connections 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 --2- 172.21.15.46:0/3794479154 >> v2:172.21.15.162:3300/0 conn(0x7fc66c0adcf0 0x7fc66c0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 --2- 172.21.15.46:0/3794479154 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c0c7cf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 -- 172.21.15.46:0/3794479154 >> 172.21.15.46:0/3794479154 conn(0x7fc66c067750 msgr2=0x7fc66c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 -- 172.21.15.46:0/3794479154 shutdown_connections 2024-08-17T02:28:14.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.652+0000 7fc673c00640 1 -- 172.21.15.46:0/3794479154 wait complete. 2024-08-17T02:28:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.654+0000 7fc673c00640 1 Processor -- start 2024-08-17T02:28:14.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.654+0000 7fc673c00640 1 -- start start 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c0adcf0 0x7fc66c14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c150370 con 0x7fc66c156c50 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c14f4c0 con 0x7fc66c0adcf0 2024-08-17T02:28:14.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc673c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c14f760 con 0x7fc66c0abb00 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43504/0 (socket says 172.21.15.46:43504) 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 -- 172.21.15.46:0/2977329898 learned_addr learned my addr 172.21.15.46:0/2977329898 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc66be00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c0adcf0 0x7fc66c14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 -- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 msgr2=0x7fc66c148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 -- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c0adcf0 msgr2=0x7fc66c14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c0adcf0 0x7fc66c14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.655+0000 7fc671c00640 1 -- 172.21.15.46:0/2977329898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009450 con 0x7fc66c156c50 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc671c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d180 tx=0x7fc664009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664015400 con 0x7fc66c156c50 2024-08-17T02:28:14.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66400f040 con 0x7fc66c156c50 2024-08-17T02:28:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640157b0 con 0x7fc66c156c50 2024-08-17T02:28:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c14fa40 con 0x7fc66c156c50 2024-08-17T02:28:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.656+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c150000 con 0x7fc66c156c50 2024-08-17T02:28:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.657+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c157dc0 con 0x7fc66c156c50 2024-08-17T02:28:14.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.658+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc664015ba0 con 0x7fc66c156c50 2024-08-17T02:28:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.659+0000 7fc65fe00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 0x7fc64c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.659+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc664082c30 con 0x7fc66c156c50 2024-08-17T02:28:14.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.659+0000 7fc671200640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 0x7fc64c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.660+0000 7fc671200640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 0x7fc64c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc660034000 tx=0x7fc660032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.663+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc66c157dc0 con 0x7fc66c156c50 2024-08-17T02:28:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.846+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc66c157dc0 con 0x7fc66c156c50 2024-08-17T02:28:14.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.847+0000 7fc65fe00640 1 -- 172.21.15.46:0/2977329898 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc66c157dc0 con 0x7fc66c156c50 2024-08-17T02:28:14.848 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:28:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 msgr2=0x7fc64c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 0x7fc64c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc660034000 tx=0x7fc660032000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 msgr2=0x7fc66c148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d180 tx=0x7fc664009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 shutdown_connections 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc66c156c50 0x7fc66c148e70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc66c0adcf0 0x7fc66c14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc64c065150 0x7fc64c067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 --2- 172.21.15.46:0/2977329898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc66c0abb00 0x7fc66c148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 >> 172.21.15.46:0/2977329898 conn(0x7fc66c067750 msgr2=0x7fc66c068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 shutdown_connections 2024-08-17T02:28:14.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:14.849+0000 7fc673c00640 1 -- 172.21.15.46:0/2977329898 wait complete. 2024-08-17T02:28:14.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:15.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.018+0000 7f6338800640 1 Processor -- start 2024-08-17T02:28:15.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.018+0000 7f6338800640 1 -- start start 2024-08-17T02:28:15.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6338800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6338800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6330155e50 0x7f63300c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6338800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63301598f0 con 0x7f6330155a80 2024-08-17T02:28:15.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6338800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6330159bd0 con 0x7f6330155e50 2024-08-17T02:28:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6338800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6330159eb0 con 0x7f63300c7db0 2024-08-17T02:28:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.019+0000 7f6336800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6330155e50 0x7f63300c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6335e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6330155a80 0x7f633006dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44996/0 (socket says 172.21.15.46:44996) 2024-08-17T02:28:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6335e00640 1 -- 172.21.15.46:0/2569678523 learned_addr learned my addr 172.21.15.46:0/2569678523 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:15.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6335400640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6336800640 1 -- 172.21.15.46:0/2569678523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 msgr2=0x7f63300c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6336800640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6336800640 1 -- 172.21.15.46:0/2569678523 >> v1:172.21.15.46:6789/0 conn(0x7f6330155a80 legacy=0x7f633006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.020+0000 7f6336800640 1 -- 172.21.15.46:0/2569678523 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633015a190 con 0x7f6330155e50 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.021+0000 7f6336800640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155e50 0x7f63300c9110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f632c009e60 tx=0x7f632c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eebae202a703c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.021+0000 7f6334a00640 1 -- 172.21.15.46:0/2569678523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c007550 con 0x7f6330155e50 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.021+0000 7f6334a00640 1 -- 172.21.15.46:0/2569678523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c02d050 con 0x7f6330155e50 2024-08-17T02:28:15.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.021+0000 7f6334a00640 1 -- 172.21.15.46:0/2569678523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c007920 con 0x7f6330155e50 2024-08-17T02:28:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 -- 172.21.15.46:0/2569678523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155e50 msgr2=0x7f63300c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155e50 0x7f63300c9110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f632c009e60 tx=0x7f632c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 -- 172.21.15.46:0/2569678523 shutdown_connections 2024-08-17T02:28:15.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155e50 0x7f63300c9110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 --2- 172.21.15.46:0/2569678523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 -- 172.21.15.46:0/2569678523 >> 172.21.15.46:0/2569678523 conn(0x7f6330067750 msgr2=0x7f63300c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 -- 172.21.15.46:0/2569678523 shutdown_connections 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.022+0000 7f6338800640 1 -- 172.21.15.46:0/2569678523 wait complete. 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.023+0000 7f6338800640 1 Processor -- start 2024-08-17T02:28:15.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.024+0000 7f6338800640 1 -- start start 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.024+0000 7f6338800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.024+0000 7f6338800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6338800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330155e50 0x7f6330158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6338800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330157310 con 0x7f6330155a80 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6338800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330158170 con 0x7f6330155e50 2024-08-17T02:28:15.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6338800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300add00 con 0x7f63300c7db0 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43520/0 (socket says 172.21.15.46:43520) 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 -- 172.21.15.46:0/4289412966 learned_addr learned my addr 172.21.15.46:0/4289412966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335e00640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6336800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330155e50 0x7f6330158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 -- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 msgr2=0x7f63300ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 -- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330155e50 msgr2=0x7f6330158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330155e50 0x7f6330158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 -- 172.21.15.46:0/4289412966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009a20 con 0x7f6330155a80 2024-08-17T02:28:15.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.025+0000 7f6335400640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f632000ea50 tx=0x7f63200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.026+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632000ca10 con 0x7f6330155a80 2024-08-17T02:28:15.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.026+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632000cb70 con 0x7f6330155a80 2024-08-17T02:28:15.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.026+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320013470 con 0x7f6330155a80 2024-08-17T02:28:15.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.026+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6330157560 con 0x7f6330155a80 2024-08-17T02:28:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.026+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6330157b20 con 0x7f6330155a80 2024-08-17T02:28:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.027+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6330071050 con 0x7f6330155a80 2024-08-17T02:28:15.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.028+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6320013860 con 0x7f6330155a80 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.029+0000 7f6329600640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 0x7f6314067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.029+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6320082940 con 0x7f6330155a80 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.030+0000 7f6335e00640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 0x7f6314067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.030+0000 7f6335e00640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 0x7f6314067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.033+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6320050a20 con 0x7f6330155a80 2024-08-17T02:28:15.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.212+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f633006aa10 con 0x7f6330155a80 2024-08-17T02:28:15.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.213+0000 7f6329600640 1 -- 172.21.15.46:0/4289412966 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6320054040 con 0x7f6330155a80 2024-08-17T02:28:15.214 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 msgr2=0x7f6314067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 0x7f6314067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324009040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 msgr2=0x7f6330145230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f632000ea50 tx=0x7f63200090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 shutdown_connections 2024-08-17T02:28:15.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6330155e50 0x7f6330158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6330155a80 0x7f6330145230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6314065150 0x7f6314067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 --2- 172.21.15.46:0/4289412966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63300c7db0 0x7f63300ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 >> 172.21.15.46:0/4289412966 conn(0x7f6330067750 msgr2=0x7f63301510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 shutdown_connections 2024-08-17T02:28:15.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.215+0000 7f6338800640 1 -- 172.21.15.46:0/4289412966 wait complete. 2024-08-17T02:28:15.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:15.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.382+0000 7f091a200640 1 Processor -- start 2024-08-17T02:28:15.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.382+0000 7f091a200640 1 -- start start 2024-08-17T02:28:15.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0914155a20 0x7f09140adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0914155df0 0x7f09140ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f091406d7f0 0x7f091406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140b0350 con 0x7f0914155a20 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0914156670 con 0x7f0914155df0 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f091a200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091406e180 con 0x7f091406d7f0 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f0913400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0914155a20 0x7f09140adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f0913400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0914155a20 0x7f09140adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43522/0 (socket says 172.21.15.46:43522) 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.383+0000 7f0913400640 1 -- 172.21.15.46:0/3017753911 learned_addr learned my addr 172.21.15.46:0/3017753911 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913e00640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f091406d7f0 0x7f091406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f090be00640 1 --2- 172.21.15.46:0/3017753911 >> v2:172.21.15.162:3300/0 conn(0x7f0914155df0 0x7f09140ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913400640 1 -- 172.21.15.46:0/3017753911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f091406d7f0 msgr2=0x7f091406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913400640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f091406d7f0 0x7f091406dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913400640 1 -- 172.21.15.46:0/3017753911 >> v2:172.21.15.162:3300/0 conn(0x7f0914155df0 msgr2=0x7f09140ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913400640 1 --2- 172.21.15.46:0/3017753911 >> v2:172.21.15.162:3300/0 conn(0x7f0914155df0 0x7f09140ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.384+0000 7f0913400640 1 -- 172.21.15.46:0/3017753911 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091406e5e0 con 0x7f0914155a20 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.385+0000 7f0913400640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f09140adf10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f091406aa10 tx=0x7f09040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954b3c28a7ad622 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.385+0000 7f0912a00640 1 -- 172.21.15.46:0/3017753911 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090402add0 con 0x7f0914155a20 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.385+0000 7f0912a00640 1 -- 172.21.15.46:0/3017753911 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0904032440 con 0x7f0914155a20 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.385+0000 7f0912a00640 1 -- 172.21.15.46:0/3017753911 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0904032820 con 0x7f0914155a20 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 -- 172.21.15.46:0/3017753911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 msgr2=0x7f09140adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f09140adf10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f091406aa10 tx=0x7f09040091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 -- 172.21.15.46:0/3017753911 shutdown_connections 2024-08-17T02:28:15.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f091406d7f0 0x7f091406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 --2- 172.21.15.46:0/3017753911 >> v2:172.21.15.162:3300/0 conn(0x7f0914155df0 0x7f09140ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 --2- 172.21.15.46:0/3017753911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f09140adf10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 -- 172.21.15.46:0/3017753911 >> 172.21.15.46:0/3017753911 conn(0x7f09140cb9b0 msgr2=0x7f09140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 -- 172.21.15.46:0/3017753911 shutdown_connections 2024-08-17T02:28:15.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.386+0000 7f091a200640 1 -- 172.21.15.46:0/3017753911 wait complete. 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.387+0000 7f091a200640 1 Processor -- start 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.387+0000 7f091a200640 1 -- start start 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091406d7f0 0x7f091415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0914155df0 0x7f09140a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091406a7f0 con 0x7f0914155a20 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140abf90 con 0x7f091406d7f0 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f091a200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140ac270 con 0x7f0914155df0 2024-08-17T02:28:15.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f090be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f090be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43534/0 (socket says 172.21.15.46:43534) 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.388+0000 7f090be00640 1 -- 172.21.15.46:0/4160189881 learned_addr learned my addr 172.21.15.46:0/4160189881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f0913e00640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0914155df0 0x7f09140a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f0913400640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091406d7f0 0x7f091415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 -- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0914155df0 msgr2=0x7f09140a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0914155df0 0x7f09140a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 -- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091406d7f0 msgr2=0x7f091415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091406d7f0 0x7f091415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 -- 172.21.15.46:0/4160189881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009450 con 0x7f0914155a20 2024-08-17T02:28:15.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090be00640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00d860 tx=0x7f08fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.389+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0096a0 con 0x7f0914155a20 2024-08-17T02:28:15.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.390+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc009800 con 0x7f0914155a20 2024-08-17T02:28:15.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.390+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc009bc0 con 0x7f0914155a20 2024-08-17T02:28:15.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.390+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140ac550 con 0x7f0914155a20 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.390+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091413dd20 con 0x7f0914155a20 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.391+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09140abdd0 con 0x7f0914155a20 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.391+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08fc014410 con 0x7f0914155a20 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.392+0000 7f090aa00640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.392+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08fc082b70 con 0x7f0914155a20 2024-08-17T02:28:15.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.393+0000 7f0913400640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.393+0000 7f0913400640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 0x7f08f0067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0904034000 tx=0x7f0904032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.397+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08fc050d00 con 0x7f0914155a20 2024-08-17T02:28:15.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.617+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0914064db0 con 0x7f0914155a20 2024-08-17T02:28:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.618+0000 7f090aa00640 1 -- 172.21.15.46:0/4160189881 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f08fc054320 con 0x7f0914155a20 2024-08-17T02:28:15.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:15.619 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:28:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 msgr2=0x7f08f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 0x7f08f0067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0904034000 tx=0x7f0904032000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 msgr2=0x7f091413d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00d860 tx=0x7f08fc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 shutdown_connections 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f08f0065150 0x7f08f0067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0914155df0 0x7f09140a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0914155a20 0x7f091413d7e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 --2- 172.21.15.46:0/4160189881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091406d7f0 0x7f091415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 >> 172.21.15.46:0/4160189881 conn(0x7f09140cb9b0 msgr2=0x7f091415fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 shutdown_connections 2024-08-17T02:28:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.620+0000 7f091a200640 1 -- 172.21.15.46:0/4160189881 wait complete. 2024-08-17T02:28:15.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.785+0000 7fb52a400640 1 Processor -- start 2024-08-17T02:28:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.786+0000 7fb52a400640 1 -- start start 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb52a400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb524069170 0x7fb5240695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb52a400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb52415c8d0 0x7fb52415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb52a400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb524069b00 con 0x7fb524068510 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb52a400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240688e0 con 0x7fb524069170 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb52a400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52406e540 con 0x7fb52415c8d0 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb523e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb524069170 0x7fb5240695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb529000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb524068510 0x7fb52406de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:44998/0 (socket says 172.21.15.46:44998) 2024-08-17T02:28:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb529000640 1 -- 172.21.15.46:0/1559508282 learned_addr learned my addr 172.21.15.46:0/1559508282 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.787+0000 7fb529a00640 1 --2- 172.21.15.46:0/1559508282 >> v2:172.21.15.162:3300/0 conn(0x7fb52415c8d0 0x7fb52415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.788+0000 7fb523e00640 1 -- 172.21.15.46:0/1559508282 >> v2:172.21.15.162:3300/0 conn(0x7fb52415c8d0 msgr2=0x7fb52415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.788+0000 7fb523e00640 1 --2- 172.21.15.46:0/1559508282 >> v2:172.21.15.162:3300/0 conn(0x7fb52415c8d0 0x7fb52415ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.788+0000 7fb523e00640 1 -- 172.21.15.46:0/1559508282 >> v1:172.21.15.46:6789/0 conn(0x7fb524068510 legacy=0x7fb52406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.788+0000 7fb523e00640 1 -- 172.21.15.46:0/1559508282 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52406d0b0 con 0x7fb524069170 2024-08-17T02:28:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.788+0000 7fb523400640 1 -- 172.21.15.46:0/1559508282 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217812780 0 0) 0x7fb524069b00 con 0x7fb524068510 2024-08-17T02:28:15.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb523e00640 1 --2- 172.21.15.46:0/1559508282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524069170 0x7fb5240695c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb52406b9d0 tx=0x7fb5100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abade69d9d49ff51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb523400640 1 -- 172.21.15.46:0/1559508282 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51002adb0 con 0x7fb524069170 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb523400640 1 -- 172.21.15.46:0/1559508282 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510032440 con 0x7fb524069170 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb523400640 1 -- 172.21.15.46:0/1559508282 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100327e0 con 0x7fb524069170 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb52a400640 1 -- 172.21.15.46:0/1559508282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524069170 msgr2=0x7fb5240695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.789+0000 7fb52a400640 1 --2- 172.21.15.46:0/1559508282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524069170 0x7fb5240695c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb52406b9d0 tx=0x7fb5100090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 -- 172.21.15.46:0/1559508282 shutdown_connections 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 --2- 172.21.15.46:0/1559508282 >> v2:172.21.15.162:3300/0 conn(0x7fb52415c8d0 0x7fb52415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 --2- 172.21.15.46:0/1559508282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524069170 0x7fb5240695c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 -- 172.21.15.46:0/1559508282 >> 172.21.15.46:0/1559508282 conn(0x7fb5240cc040 msgr2=0x7fb5240cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 -- 172.21.15.46:0/1559508282 shutdown_connections 2024-08-17T02:28:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.790+0000 7fb52a400640 1 -- 172.21.15.46:0/1559508282 wait complete. 2024-08-17T02:28:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.791+0000 7fb52a400640 1 Processor -- start 2024-08-17T02:28:15.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.791+0000 7fb52a400640 1 -- start start 2024-08-17T02:28:15.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 0x7fb524158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 0x7fb52415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52415d8a0 con 0x7fb524068510 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240c6460 con 0x7fb52415c8d0 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb52a400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240c6740 con 0x7fb524069170 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb529000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb529000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43560/0 (socket says 172.21.15.46:43560) 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.792+0000 7fb529000640 1 -- 172.21.15.46:0/3381801833 learned_addr learned my addr 172.21.15.46:0/3381801833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb523e00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 0x7fb524158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529a00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 0x7fb52415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 -- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 msgr2=0x7fb524158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 0x7fb524158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 -- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 msgr2=0x7fb52415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 0x7fb52415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 -- 172.21.15.46:0/3381801833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510009390 con 0x7fb524068510 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb523e00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 0x7fb524158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529a00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 0x7fb52415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb529000640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c5e0 tx=0x7fb518007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb518005aa0 con 0x7fb524068510 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb518005c00 con 0x7fb524068510 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5240c6a20 con 0x7fb524068510 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.793+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5180070f0 con 0x7fb524068510 2024-08-17T02:28:15.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.794+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5240c6fe0 con 0x7fb524068510 2024-08-17T02:28:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.795+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb524071050 con 0x7fb524068510 2024-08-17T02:28:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.795+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb518007520 con 0x7fb524068510 2024-08-17T02:28:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.796+0000 7fb517e00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:15.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.796+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb518081fb0 con 0x7fb524068510 2024-08-17T02:28:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.797+0000 7fb523e00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:15.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.797+0000 7fb523e00640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 0x7fb504067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:15.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.800+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb518050050 con 0x7fb524068510 2024-08-17T02:28:15.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.982+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5240c9c20 con 0x7fb524068510 2024-08-17T02:28:15.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.983+0000 7fb517e00640 1 -- 172.21.15.46:0/3381801833 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb518053670 con 0x7fb524068510 2024-08-17T02:28:15.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:15.984 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 msgr2=0x7fb504067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 0x7fb504067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb510034000 tx=0x7fb510032000 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 msgr2=0x7fb5240994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c5e0 tx=0x7fb518007d60 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 shutdown_connections 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb52415c8d0 0x7fb52415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb504065150 0x7fb504067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb524069170 0x7fb524158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 --2- 172.21.15.46:0/3381801833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb524068510 0x7fb5240994e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:15.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 >> 172.21.15.46:0/3381801833 conn(0x7fb5240cc040 msgr2=0x7fb5240ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 shutdown_connections 2024-08-17T02:28:15.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:15.985+0000 7fb52a400640 1 -- 172.21.15.46:0/3381801833 wait complete. 2024-08-17T02:28:16.001 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:16.001 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:16.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.152+0000 7fc0d8000640 1 Processor -- start 2024-08-17T02:28:16.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.152+0000 7fc0d8000640 1 -- start start 2024-08-17T02:28:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d8000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 0x7fc0d00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d8000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d0156670 con 0x7fc0d0155a20 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d8000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d006e5e0 con 0x7fc0d006df00 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d8000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00b0350 con 0x7fc0d0155df0 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d5600640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc0d0155a20 0x7fc0d006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45006/0 (socket says 172.21.15.46:45006) 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d5600640 1 -- 172.21.15.46:0/675953909 learned_addr learned my addr 172.21.15.46:0/675953909 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0d6000640 1 --2- 172.21.15.46:0/675953909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 0x7fc0d00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353292172 0 0) 0x7fc0d0156670 con 0x7fc0d0155a20 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b80034e0 con 0x7fc0d0155a20 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030816409 0 0) 0x7fc0d006e5e0 con 0x7fc0d006df00 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.154+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d0156670 con 0x7fc0d006df00 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.155+0000 7fc0d6000640 1 -- 172.21.15.46:0/675953909 >> v1:172.21.15.162:6789/0 conn(0x7fc0d006df00 legacy=0x7fc0d0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.155+0000 7fc0d6000640 1 -- 172.21.15.46:0/675953909 >> v1:172.21.15.46:6789/0 conn(0x7fc0d0155a20 legacy=0x7fc0d006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.155+0000 7fc0d6000640 1 -- 172.21.15.46:0/675953909 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d006e8c0 con 0x7fc0d0155df0 2024-08-17T02:28:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0d6000640 1 --2- 172.21.15.46:0/675953909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 0x7fc0d00adf10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009e90 tx=0x7fc0c8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df575c49c37e00f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8007550 con 0x7fc0d0155df0 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c802d050 con 0x7fc0d0155df0 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0cfe00640 1 -- 172.21.15.46:0/675953909 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c80078e0 con 0x7fc0d0155df0 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0d8000640 1 -- 172.21.15.46:0/675953909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 msgr2=0x7fc0d00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.156+0000 7fc0d8000640 1 --2- 172.21.15.46:0/675953909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 0x7fc0d00adf10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009e90 tx=0x7fc0c8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.157+0000 7fc0d8000640 1 -- 172.21.15.46:0/675953909 shutdown_connections 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.157+0000 7fc0d8000640 1 --2- 172.21.15.46:0/675953909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155df0 0x7fc0d00adf10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.157+0000 7fc0d8000640 1 -- 172.21.15.46:0/675953909 >> 172.21.15.46:0/675953909 conn(0x7fc0d00cb9b0 msgr2=0x7fc0d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.157+0000 7fc0d8000640 1 -- 172.21.15.46:0/675953909 shutdown_connections 2024-08-17T02:28:16.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.157+0000 7fc0d8000640 1 -- 172.21.15.46:0/675953909 wait complete. 2024-08-17T02:28:16.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.158+0000 7fc0d8000640 1 Processor -- start 2024-08-17T02:28:16.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.158+0000 7fc0d8000640 1 -- start start 2024-08-17T02:28:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 0x7fc0d014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155a20 0x7fc0d0153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d016c540 con 0x7fc0d0155df0 2024-08-17T02:28:16.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0068b90 con 0x7fc0d006df00 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d8000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d0068e70 con 0x7fc0d0155a20 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43574/0 (socket says 172.21.15.46:43574) 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d6000640 1 -- 172.21.15.46:0/1953565702 learned_addr learned my addr 172.21.15.46:0/1953565702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.159+0000 7fc0d5600640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 0x7fc0d014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d4c00640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155a20 0x7fc0d0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 -- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155a20 msgr2=0x7fc0d0153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155a20 0x7fc0d0153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 -- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 msgr2=0x7fc0d014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 0x7fc0d014d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 -- 172.21.15.46:0/1953565702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8009a20 con 0x7fc0d0155df0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d5600640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 0x7fc0d014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d6000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009de0 tx=0x7fc0c8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c8031ac0 con 0x7fc0d0155df0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c8031c40 con 0x7fc0d0155df0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c803c420 con 0x7fc0d0155df0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d0069150 con 0x7fc0d0155df0 2024-08-17T02:28:16.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.160+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d00687b0 con 0x7fc0d0155df0 2024-08-17T02:28:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.161+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d016c6b0 con 0x7fc0d0155df0 2024-08-17T02:28:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.162+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0c803c850 con 0x7fc0d0155df0 2024-08-17T02:28:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.163+0000 7fc0ccc00640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 0x7fc0b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.163+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0c80a3520 con 0x7fc0d0155df0 2024-08-17T02:28:16.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.164+0000 7fc0d5600640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 0x7fc0b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.164+0000 7fc0d5600640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 0x7fc0b0067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005840 tx=0x7fc0c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.167+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0d016c6b0 con 0x7fc0d0155df0 2024-08-17T02:28:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.388+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0d016c6b0 con 0x7fc0d0155df0 2024-08-17T02:28:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.388+0000 7fc0ccc00640 1 -- 172.21.15.46:0/1953565702 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fc0d016c6b0 con 0x7fc0d0155df0 2024-08-17T02:28:16.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:16.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 msgr2=0x7fc0b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 0x7fc0b0067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005840 tx=0x7fc0c4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 msgr2=0x7fc0d0069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8009de0 tx=0x7fc0c8037000 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 shutdown_connections 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0d0155df0 0x7fc0d0069d70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc0b0065150 0x7fc0b0067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0d0155a20 0x7fc0d0153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 --2- 172.21.15.46:0/1953565702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0d006df00 0x7fc0d014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 >> 172.21.15.46:0/1953565702 conn(0x7fc0d00cb9b0 msgr2=0x7fc0d0154c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 shutdown_connections 2024-08-17T02:28:16.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.391+0000 7fc0d8000640 1 -- 172.21.15.46:0/1953565702 wait complete. 2024-08-17T02:28:16.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.560+0000 7f5566000640 1 Processor -- start 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.560+0000 7f5566000640 1 -- start start 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f5566000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55600cbea0 0x7f5560156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f5566000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556006dc80 0x7f55601577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f5566000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600cc300 con 0x7f5560156ad0 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f5566000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600ca900 con 0x7f55600cbea0 2024-08-17T02:28:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f5566000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600cc560 con 0x7f556006dc80 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.561+0000 7f555fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55600cbea0 0x7f5560156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f55600cbea0 0x7f5560156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43588/0 (socket says 172.21.15.46:43588) 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 -- 172.21.15.46:0/1762750400 learned_addr learned my addr 172.21.15.46:0/1762750400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f5565600640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556006dc80 0x7f55601577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 -- 172.21.15.46:0/1762750400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556006dc80 msgr2=0x7f55601577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556006dc80 0x7f55601577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 -- 172.21.15.46:0/1762750400 >> v1:172.21.15.162:6789/0 conn(0x7f5560156ad0 legacy=0x7f556006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.562+0000 7f555fe00640 1 -- 172.21.15.46:0/1762750400 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600caaf0 con 0x7f55600cbea0 2024-08-17T02:28:16.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.563+0000 7f555fe00640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55600cbea0 0x7f5560156ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f554c009910 tx=0x7f554c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8856dcc25c156d78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.563+0000 7f555f400640 1 -- 172.21.15.46:0/1762750400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c02ae40 con 0x7f55600cbea0 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.563+0000 7f555f400640 1 -- 172.21.15.46:0/1762750400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c032440 con 0x7f55600cbea0 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.563+0000 7f555f400640 1 -- 172.21.15.46:0/1762750400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c032820 con 0x7f55600cbea0 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 -- 172.21.15.46:0/1762750400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55600cbea0 msgr2=0x7f5560156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55600cbea0 0x7f5560156ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f554c009910 tx=0x7f554c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 -- 172.21.15.46:0/1762750400 shutdown_connections 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556006dc80 0x7f55601577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 --2- 172.21.15.46:0/1762750400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55600cbea0 0x7f5560156ea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 -- 172.21.15.46:0/1762750400 >> 172.21.15.46:0/1762750400 conn(0x7f5560067750 msgr2=0x7f55600cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 -- 172.21.15.46:0/1762750400 shutdown_connections 2024-08-17T02:28:16.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.564+0000 7f5566000640 1 -- 172.21.15.46:0/1762750400 wait complete. 2024-08-17T02:28:16.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.565+0000 7f5566000640 1 Processor -- start 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.566+0000 7f5566000640 1 -- start start 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.566+0000 7f5566000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.566+0000 7f5566000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cbea0 0x7f55600c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.566+0000 7f5566000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5560156ad0 0x7f55600a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5566000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556016a3d0 con 0x7f556006dc80 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5566000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c7430 con 0x7f5560156ad0 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5566000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c6900 con 0x7f55600cbea0 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43590/0 (socket says 172.21.15.46:43590) 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 -- 172.21.15.46:0/551676843 learned_addr learned my addr 172.21.15.46:0/551676843 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:16.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5565600640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5560156ad0 0x7f55600a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f555fe00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cbea0 0x7f55600c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 -- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cbea0 msgr2=0x7f55600c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cbea0 0x7f55600c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 -- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5560156ad0 msgr2=0x7f55600a87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5560156ad0 0x7f55600a87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.567+0000 7f5564c00640 1 -- 172.21.15.46:0/551676843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009450 con 0x7f556006dc80 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5564c00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f555400c4c0 tx=0x7f5554007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554016070 con 0x7f556006dc80 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5554007020 con 0x7f556006dc80 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540073e0 con 0x7f556006dc80 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600c6b90 con 0x7f556006dc80 2024-08-17T02:28:16.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.568+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600c7150 con 0x7f556006dc80 2024-08-17T02:28:16.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.569+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5560071050 con 0x7f556006dc80 2024-08-17T02:28:16.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.570+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5554006790 con 0x7f556006dc80 2024-08-17T02:28:16.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.571+0000 7f5553e00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 0x7f5540067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.571+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5554081ac0 con 0x7f556006dc80 2024-08-17T02:28:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.571+0000 7f555fe00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 0x7f5540067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.572+0000 7f555fe00640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 0x7f5540067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f554c034000 tx=0x7f554c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.575+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f555404fc30 con 0x7f556006dc80 2024-08-17T02:28:16.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.799+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f556006f480 con 0x7f556006dc80 2024-08-17T02:28:16.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.800+0000 7f5553e00640 1 -- 172.21.15.46:0/551676843 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f5554053250 con 0x7f556006dc80 2024-08-17T02:28:16.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:16.801 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1173626951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1173626951},{"type":"v1","addr":"172.21.15.162:6835","nonce":1173626951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2745833991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2745833991},{"type":"v1","addr":"172.21.15.46:6833","nonce":2745833991}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3517254265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3517254265},{"type":"v1","addr":"172.21.15.46:6835","nonce":3517254265}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:38.638262+0000","modified":"2024-08-17T02:27:42.214800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/2952404167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2952404167},{"type":"v1","addr":"172.21.15.162:6837","nonce":2952404167}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:16.801 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-08-17T02:28:16.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 msgr2=0x7f5540067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 0x7f5540067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f554c034000 tx=0x7f554c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:16.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 msgr2=0x7f5560169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f555400c4c0 tx=0x7f5554007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 shutdown_connections 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5560156ad0 0x7f55600a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5540065150 0x7f5540067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cbea0 0x7f55600c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 --2- 172.21.15.46:0/551676843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f556006dc80 0x7f5560169c10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 >> 172.21.15.46:0/551676843 conn(0x7f5560067750 msgr2=0x7f5560153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 shutdown_connections 2024-08-17T02:28:16.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.802+0000 7f5566000640 1 -- 172.21.15.46:0/551676843 wait complete. 2024-08-17T02:28:16.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:16.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.968+0000 7f9dabe00640 1 Processor -- start 2024-08-17T02:28:16.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.969+0000 7f9dabe00640 1 -- start start 2024-08-17T02:28:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dac156ad0 0x7f9dac0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9dac06dab0 0x7f9dac06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac06e450 con 0x7f9dac156ad0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0ca900 con 0x7f9dac06dab0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dabe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0cc560 con 0x7f9dac156ea0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9daaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dac156ad0 0x7f9dac0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9daaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9dac156ad0 0x7f9dac0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43606/0 (socket says 172.21.15.46:43606) 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9daaa00640 1 -- 172.21.15.46:0/3395443778 learned_addr learned my addr 172.21.15.46:0/3395443778 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.970+0000 7f9dab400640 1 --2- 172.21.15.46:0/3395443778 >> v2:172.21.15.162:3300/0 conn(0x7f9dac06dab0 0x7f9dac06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9da3e00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9daaa00640 1 -- 172.21.15.46:0/3395443778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 msgr2=0x7f9dac06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9daaa00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9daaa00640 1 -- 172.21.15.46:0/3395443778 >> v2:172.21.15.162:3300/0 conn(0x7f9dac06dab0 msgr2=0x7f9dac06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9daaa00640 1 --2- 172.21.15.46:0/3395443778 >> v2:172.21.15.162:3300/0 conn(0x7f9dac06dab0 0x7f9dac06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9daaa00640 1 -- 172.21.15.46:0/3395443778 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0caaf0 con 0x7f9dac156ad0 2024-08-17T02:28:16.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.971+0000 7f9da3e00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.972+0000 7f9daaa00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac156ad0 0x7f9dac0cbea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cb740 tx=0x7f9d9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4d5e0a19806586 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.972+0000 7f9daa000640 1 -- 172.21.15.46:0/3395443778 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c02ade0 con 0x7f9dac156ad0 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.972+0000 7f9daa000640 1 -- 172.21.15.46:0/3395443778 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c032440 con 0x7f9dac156ad0 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.972+0000 7f9daa000640 1 -- 172.21.15.46:0/3395443778 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0327e0 con 0x7f9dac156ad0 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 -- 172.21.15.46:0/3395443778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac156ad0 msgr2=0x7f9dac0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac156ad0 0x7f9dac0cbea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0cb740 tx=0x7f9d9c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 -- 172.21.15.46:0/3395443778 shutdown_connections 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 --2- 172.21.15.46:0/3395443778 >> v2:172.21.15.162:3300/0 conn(0x7f9dac06dab0 0x7f9dac06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 --2- 172.21.15.46:0/3395443778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac156ad0 0x7f9dac0cbea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 -- 172.21.15.46:0/3395443778 >> 172.21.15.46:0/3395443778 conn(0x7f9dac067750 msgr2=0x7f9dac0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 -- 172.21.15.46:0/3395443778 shutdown_connections 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.973+0000 7f9dabe00640 1 -- 172.21.15.46:0/3395443778 wait complete. 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.974+0000 7f9dabe00640 1 Processor -- start 2024-08-17T02:28:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.974+0000 7f9dabe00640 1 -- start start 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dac156ad0 0x7f9dac159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac15a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac157e40 con 0x7f9dac06dab0 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac1516d0 con 0x7f9dac156ad0 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9dabe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c6460 con 0x7f9dac156ea0 2024-08-17T02:28:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9daaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9daaa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43622/0 (socket says 172.21.15.46:43622) 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.975+0000 7f9daaa00640 1 -- 172.21.15.46:0/2429364295 learned_addr learned my addr 172.21.15.46:0/2429364295 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 -- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 msgr2=0x7f9dac15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 -- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dac156ad0 msgr2=0x7f9dac159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dac156ad0 0x7f9dac159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 -- 172.21.15.46:0/2429364295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c009450 con 0x7f9dac06dab0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9daaa00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c035040 tx=0x7f9d9c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c031c80 con 0x7f9dac06dab0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c031e20 con 0x7f9dac06dab0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c03d670 con 0x7f9dac06dab0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.976+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0c6740 con 0x7f9dac06dab0 2024-08-17T02:28:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.977+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac157ad0 con 0x7f9dac06dab0 2024-08-17T02:28:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.978+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac071050 con 0x7f9dac06dab0 2024-08-17T02:28:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.979+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d9c039040 con 0x7f9dac06dab0 2024-08-17T02:28:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.979+0000 7f9da2000640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 0x7f9d88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.980+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d9c0a2660 con 0x7f9dac06dab0 2024-08-17T02:28:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.980+0000 7f9da3e00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 0x7f9d88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.981+0000 7f9da3e00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 0x7f9d88067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0c7e80 tx=0x7f9d94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:16.984+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9d9c070680 con 0x7f9dac06dab0 2024-08-17T02:28:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.171+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dac0c9e00 con 0x7f9dac06dab0 2024-08-17T02:28:17.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.172+0000 7f9da2000640 1 -- 172.21.15.46:0/2429364295 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9d9c073ca0 con 0x7f9dac06dab0 2024-08-17T02:28:17.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:17.175 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:27:39.930777+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:36.821962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:37.622480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 msgr2=0x7f9d88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 0x7f9d88067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0c7e80 tx=0x7f9d94008040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 msgr2=0x7f9dac13e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c035040 tx=0x7f9d9c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 shutdown_connections 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9d88065150 0x7f9d88067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9dac156ea0 0x7f9dac15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dac156ad0 0x7f9dac159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 --2- 172.21.15.46:0/2429364295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dac06dab0 0x7f9dac13e910 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 >> 172.21.15.46:0/2429364295 conn(0x7f9dac067750 msgr2=0x7f9dac06c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 shutdown_connections 2024-08-17T02:28:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.174+0000 7f9dabe00640 1 -- 172.21.15.46:0/2429364295 wait complete. 2024-08-17T02:28:17.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:28:17.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.341+0000 7ff408600640 1 Processor -- start 2024-08-17T02:28:17.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.341+0000 7ff408600640 1 -- start start 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4001401b0 0x7ff4000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff400140580 0x7ff4000b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4000b1270 0x7ff4000c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4000cb450 con 0x7ff400140580 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4000b16d0 con 0x7ff4000b1270 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.342+0000 7ff408600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000caa80 con 0x7ff4001401b0 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff400140580 0x7ff4000b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff400140580 0x7ff4000b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43636/0 (socket says 172.21.15.46:43636) 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 -- 172.21.15.46:0/1666406300 learned_addr learned my addr 172.21.15.46:0/1666406300 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff406600640 1 --2- 172.21.15.46:0/1666406300 >> v2:172.21.15.162:3300/0 conn(0x7ff4000b1270 0x7ff4000c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405c00640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4001401b0 0x7ff4000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 -- 172.21.15.46:0/1666406300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4001401b0 msgr2=0x7ff4000caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4001401b0 0x7ff4000caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 -- 172.21.15.46:0/1666406300 >> v2:172.21.15.162:3300/0 conn(0x7ff4000b1270 msgr2=0x7ff4000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 --2- 172.21.15.46:0/1666406300 >> v2:172.21.15.162:3300/0 conn(0x7ff4000b1270 0x7ff4000c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.343+0000 7ff405200640 1 -- 172.21.15.46:0/1666406300 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000c9e70 con 0x7ff400140580 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.344+0000 7ff405200640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff400140580 0x7ff4000b0d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4000acbc0 tx=0x7ff3ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db7900425c25f59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.344+0000 7ff3ffe00640 1 -- 172.21.15.46:0/1666406300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec02ad40 con 0x7ff400140580 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff3ffe00640 1 -- 172.21.15.46:0/1666406300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec032440 con 0x7ff400140580 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff3ffe00640 1 -- 172.21.15.46:0/1666406300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec02aea0 con 0x7ff400140580 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 -- 172.21.15.46:0/1666406300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff400140580 msgr2=0x7ff4000b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff400140580 0x7ff4000b0d30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4000acbc0 tx=0x7ff3ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 -- 172.21.15.46:0/1666406300 shutdown_connections 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 --2- 172.21.15.46:0/1666406300 >> v2:172.21.15.162:3300/0 conn(0x7ff4000b1270 0x7ff4000c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff400140580 0x7ff4000b0d30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 --2- 172.21.15.46:0/1666406300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4001401b0 0x7ff4000caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 -- 172.21.15.46:0/1666406300 >> 172.21.15.46:0/1666406300 conn(0x7ff4000cb9b0 msgr2=0x7ff4000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 -- 172.21.15.46:0/1666406300 shutdown_connections 2024-08-17T02:28:17.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.345+0000 7ff408600640 1 -- 172.21.15.46:0/1666406300 wait complete. 2024-08-17T02:28:17.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.347+0000 7ff408600640 1 Processor -- start 2024-08-17T02:28:17.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.347+0000 7ff408600640 1 -- start start 2024-08-17T02:28:17.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4001401b0 0x7ff40015af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 0x7ff4000c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000a9970 con 0x7ff4000b1270 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40016c6c0 con 0x7ff4001401b0 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff408600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40016c9a0 con 0x7ff400140580 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff405c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff405c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43642/0 (socket says 172.21.15.46:43642) 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff405c00640 1 -- 172.21.15.46:0/1997365839 learned_addr learned my addr 172.21.15.46:0/1997365839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff405200640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4001401b0 0x7ff40015af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.348+0000 7ff406600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 0x7ff4000c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 -- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 msgr2=0x7ff4000c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 0x7ff4000c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 -- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4001401b0 msgr2=0x7ff40015af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4001401b0 0x7ff40015af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 -- 172.21.15.46:0/1997365839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec009450 con 0x7ff4000b1270 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff406600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 0x7ff4000c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff405c00640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400d890 tx=0x7ff3f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400de20 con 0x7ff4000b1270 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f400b8d0 con 0x7ff4000b1270 2024-08-17T02:28:17.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400bc70 con 0x7ff4000b1270 2024-08-17T02:28:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40016cc80 con 0x7ff4000b1270 2024-08-17T02:28:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.349+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40013f470 con 0x7ff4000b1270 2024-08-17T02:28:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.350+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff400064db0 con 0x7ff4000b1270 2024-08-17T02:28:17.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.351+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff3f4014640 con 0x7ff4000b1270 2024-08-17T02:28:17.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.352+0000 7ff3fcc00640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 0x7ff3e0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.352+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3f4082a60 con 0x7ff4000b1270 2024-08-17T02:28:17.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.352+0000 7ff405200640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 0x7ff3e0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.353+0000 7ff405200640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 0x7ff3e0067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec034000 tx=0x7ff3ec032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.357+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff3f4050b50 con 0x7ff4000b1270 2024-08-17T02:28:17.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.576+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff400069410 con 0x7ff4000b1270 2024-08-17T02:28:17.577 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-08-17T02:28:17.577+0000 7f11b8200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.582+0000 7ff3fcc00640 1 -- 172.21.15.46:0/1997365839 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff3f4054170 con 0x7ff4000b1270 2024-08-17T02:28:17.582 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 msgr2=0x7ff3e0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 0x7ff3e0067630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec034000 tx=0x7ff3ec032000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 msgr2=0x7ff40013ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400d890 tx=0x7ff3f4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 shutdown_connections 2024-08-17T02:28:17.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff3e0065180 0x7ff3e0067630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff400140580 0x7ff4000c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4001401b0 0x7ff40015af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 --2- 172.21.15.46:0/1997365839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff4000b1270 0x7ff40013ed30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 >> 172.21.15.46:0/1997365839 conn(0x7ff4000cb9b0 msgr2=0x7ff4000aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 shutdown_connections 2024-08-17T02:28:17.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.584+0000 7ff408600640 1 -- 172.21.15.46:0/1997365839 wait complete. 2024-08-17T02:28:17.589 INFO:tasks.ceph.mds.d.smithi162.stderr: -1982> 2024-08-17T02:27:43.074+0000 7fa0cec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:17.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:28:17.630 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-17T02:28:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.752+0000 7f0496800640 1 Processor -- start 2024-08-17T02:28:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.753+0000 7f0496800640 1 -- start start 2024-08-17T02:28:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0496800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 0x7f0490158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0496800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 0x7f049015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0496800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04900a9f90 con 0x7f04900cbea0 2024-08-17T02:28:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0496800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900ab260 con 0x7f049006dc80 2024-08-17T02:28:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0496800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049015d8f0 con 0x7f0490158b80 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0495e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 0x7f049015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0494a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f04900cbea0 0x7f049006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:59974/0 (socket says 172.21.15.46:59974) 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0495e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 0x7f049015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:51748/0 (socket says 172.21.15.46:51748) 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0495400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 0x7f0490158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.754+0000 7f0494a00640 1 -- 172.21.15.46:0/305693497 learned_addr learned my addr 172.21.15.46:0/305693497 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.755+0000 7f0495400640 1 -- 172.21.15.46:0/305693497 >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 msgr2=0x7f049015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.755+0000 7f0495400640 1 --2- 172.21.15.46:0/305693497 >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 0x7f049015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.755+0000 7f0495400640 1 -- 172.21.15.46:0/305693497 >> v1:172.21.15.162:6789/0 conn(0x7f04900cbea0 legacy=0x7f049006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.755+0000 7f0495400640 1 -- 172.21.15.46:0/305693497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900a9980 con 0x7f0490158b80 2024-08-17T02:28:17.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.755+0000 7f048fe00640 1 -- 172.21.15.46:0/305693497 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019181638 0 0) 0x7f04900a9f90 con 0x7f04900cbea0 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.756+0000 7f0495400640 1 --2- 172.21.15.46:0/305693497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 0x7f0490158f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0484009850 tx=0x7f04840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d297297139ea77d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.756+0000 7f048fe00640 1 -- 172.21.15.46:0/305693497 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048402ad90 con 0x7f0490158b80 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.756+0000 7f048fe00640 1 -- 172.21.15.46:0/305693497 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484032440 con 0x7f0490158b80 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.756+0000 7f048fe00640 1 -- 172.21.15.46:0/305693497 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840327e0 con 0x7f0490158b80 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 -- 172.21.15.46:0/305693497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 msgr2=0x7f0490158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 --2- 172.21.15.46:0/305693497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 0x7f0490158f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0484009850 tx=0x7f04840090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 -- 172.21.15.46:0/305693497 shutdown_connections 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 --2- 172.21.15.46:0/305693497 >> v2:172.21.15.162:3300/0 conn(0x7f049006dc80 0x7f049015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 --2- 172.21.15.46:0/305693497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0490158b80 0x7f0490158f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 -- 172.21.15.46:0/305693497 >> 172.21.15.46:0/305693497 conn(0x7f0490067750 msgr2=0x7f04900cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 -- 172.21.15.46:0/305693497 shutdown_connections 2024-08-17T02:28:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.757+0000 7f0496800640 1 -- 172.21.15.46:0/305693497 wait complete. 2024-08-17T02:28:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.758+0000 7f0496800640 1 Processor -- start 2024-08-17T02:28:17.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.758+0000 7f0496800640 1 -- start start 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f049006dc80 0x7f0490157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900cbea0 0x7f049015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c1910 con 0x7f0490158b80 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0490142d10 con 0x7f04900cbea0 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.759+0000 7f0496800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0490142100 con 0x7f049006dc80 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43652/0 (socket says 172.21.15.46:43652) 2024-08-17T02:28:17.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 -- 172.21.15.46:0/3731377831 learned_addr learned my addr 172.21.15.46:0/3731377831 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495400640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f049006dc80 0x7f0490157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0494a00640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900cbea0 0x7f049015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 -- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f049006dc80 msgr2=0x7f0490157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f049006dc80 0x7f0490157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 -- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900cbea0 msgr2=0x7f049015b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900cbea0 0x7f049015b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 -- 172.21.15.46:0/3731377831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0484009390 con 0x7f0490158b80 2024-08-17T02:28:17.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.760+0000 7f0495e00640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0488009d70 tx=0x7f048800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.761+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048800cd40 con 0x7f0490158b80 2024-08-17T02:28:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.761+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048800f040 con 0x7f0490158b80 2024-08-17T02:28:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.761+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880146d0 con 0x7f0490158b80 2024-08-17T02:28:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.761+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04901423e0 con 0x7f0490158b80 2024-08-17T02:28:17.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.761+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04901429a0 con 0x7f0490158b80 2024-08-17T02:28:17.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.762+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0490142ea0 con 0x7f0490158b80 2024-08-17T02:28:17.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.763+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0488014a80 con 0x7f0490158b80 2024-08-17T02:28:17.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.763+0000 7f048cc00640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 0x7f04700676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.763+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0488083070 con 0x7f0490158b80 2024-08-17T02:28:17.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.764+0000 7f0495400640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 0x7f04700676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.765+0000 7f0495400640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 0x7f04700676d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0484034000 tx=0x7f0484032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.768+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f04880b4e40 con 0x7f0490158b80 2024-08-17T02:28:17.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:17.989+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0490071050 con 0x7f0490158b80 2024-08-17T02:28:18.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.582+0000 7f048cc00640 1 -- 172.21.15.46:0/3731377831 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0488051230 con 0x7f0490158b80 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.584+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 msgr2=0x7f04700676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.584+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 0x7f04700676d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0484034000 tx=0x7f0484032000 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.584+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 msgr2=0x7f049015bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.584+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0488009d70 tx=0x7f048800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 shutdown_connections 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0490158b80 0x7f049015bb70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900cbea0 0x7f049015b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0470065220 0x7f04700676d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 --2- 172.21.15.46:0/3731377831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f049006dc80 0x7f0490157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 >> 172.21.15.46:0/3731377831 conn(0x7f0490067750 msgr2=0x7f049006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 shutdown_connections 2024-08-17T02:28:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.585+0000 7f0496800640 1 -- 172.21.15.46:0/3731377831 wait complete. 2024-08-17T02:28:18.603 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:18.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.761+0000 7f0fe9000640 1 Processor -- start 2024-08-17T02:28:18.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.761+0000 7f0fe9000640 1 -- start start 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.762+0000 7f0fe9000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0fe4150130 0x7f0fe40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0fe406e5f0 0x7f0fe40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe9000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe41568b0 con 0x7f0fe4156d40 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe9000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe4150500 con 0x7f0fe4150130 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe9000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe4155fc0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0fe4150130 0x7f0fe40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0fe4150130 0x7f0fe40aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43654/0 (socket says 172.21.15.46:43654) 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 -- 172.21.15.46:0/2254291453 learned_addr learned my addr 172.21.15.46:0/2254291453 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fdbe00640 1 --1- 172.21.15.46:0/2254291453 >> v1:172.21.15.46:6789/0 conn(0x7f0fe4156d40 0x7f0fe406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:45008/0 (socket says 172.21.15.46:45008) 2024-08-17T02:28:18.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe2800640 1 --2- 172.21.15.46:0/2254291453 >> v2:172.21.15.162:3300/0 conn(0x7f0fe406e5f0 0x7f0fe40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 -- 172.21.15.46:0/2254291453 >> v2:172.21.15.162:3300/0 conn(0x7f0fe406e5f0 msgr2=0x7f0fe40ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 --2- 172.21.15.46:0/2254291453 >> v2:172.21.15.162:3300/0 conn(0x7f0fe406e5f0 0x7f0fe40ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 -- 172.21.15.46:0/2254291453 >> v1:172.21.15.46:6789/0 conn(0x7f0fe4156d40 legacy=0x7f0fe406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1e00640 1 -- 172.21.15.46:0/2254291453 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe40add60 con 0x7f0fe4150130 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.763+0000 7f0fe1400640 1 -- 172.21.15.46:0/2254291453 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194036785 0 0) 0x7f0fe41568b0 con 0x7f0fe4156d40 2024-08-17T02:28:18.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe1e00640 1 --2- 172.21.15.46:0/2254291453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe4150130 0x7f0fe40aa730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4068140 tx=0x7f0fd40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba0b4d6f90367b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe1400640 1 -- 172.21.15.46:0/2254291453 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd402adf0 con 0x7f0fe4150130 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe1400640 1 -- 172.21.15.46:0/2254291453 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd4032440 con 0x7f0fe4150130 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe1400640 1 -- 172.21.15.46:0/2254291453 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40327e0 con 0x7f0fe4150130 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe9000640 1 -- 172.21.15.46:0/2254291453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe4150130 msgr2=0x7f0fe40aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.765+0000 7f0fe9000640 1 --2- 172.21.15.46:0/2254291453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe4150130 0x7f0fe40aa730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4068140 tx=0x7f0fd40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 -- 172.21.15.46:0/2254291453 shutdown_connections 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 --2- 172.21.15.46:0/2254291453 >> v2:172.21.15.162:3300/0 conn(0x7f0fe406e5f0 0x7f0fe40ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 --2- 172.21.15.46:0/2254291453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe4150130 0x7f0fe40aa730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 -- 172.21.15.46:0/2254291453 >> 172.21.15.46:0/2254291453 conn(0x7f0fe4067750 msgr2=0x7f0fe406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 -- 172.21.15.46:0/2254291453 shutdown_connections 2024-08-17T02:28:18.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.766+0000 7f0fe9000640 1 -- 172.21.15.46:0/2254291453 wait complete. 2024-08-17T02:28:18.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.767+0000 7f0fe9000640 1 Processor -- start 2024-08-17T02:28:18.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.767+0000 7f0fe9000640 1 -- start start 2024-08-17T02:28:18.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe4150130 0x7f0fe40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fe4156d40 0x7f0fe40c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4169f20 con 0x7f0fe406e5f0 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe41693a0 con 0x7f0fe4150130 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe9000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe4169680 con 0x7f0fe4156d40 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe1e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43664/0 (socket says 172.21.15.46:43664) 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.768+0000 7f0fe1e00640 1 -- 172.21.15.46:0/760028951 learned_addr learned my addr 172.21.15.46:0/760028951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fdbe00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe4150130 0x7f0fe40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe2800640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fe4156d40 0x7f0fe40c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 -- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fe4156d40 msgr2=0x7f0fe40c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fe4156d40 0x7f0fe40c0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 -- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe4150130 msgr2=0x7f0fe40c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe4150130 0x7f0fe40c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 -- 172.21.15.46:0/760028951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009450 con 0x7f0fe406e5f0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.769+0000 7f0fe1e00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402a7f0 tx=0x7f0fd4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.770+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40316b0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.770+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd4031810 con 0x7f0fe406e5f0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.770+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4169960 con 0x7f0fe406e5f0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.770+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4031bd0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.770+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe40c9ab0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.771+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe40710c0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.772+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0fd403e450 con 0x7f0fe406e5f0 2024-08-17T02:28:18.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.773+0000 7f0fd9600640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 0x7f0fc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.773+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0fd40a24b0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.774+0000 7f0fdbe00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 0x7f0fc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.774+0000 7f0fdbe00640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 0x7f0fc0067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4155920 tx=0x7f0fcc007e60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.777+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0fd40705d0 con 0x7f0fe406e5f0 2024-08-17T02:28:18.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:18.968+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0fe4064fc0 con 0x7f0fe406e5f0 2024-08-17T02:28:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.589+0000 7f0fd9600640 1 -- 172.21.15.46:0/760028951 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0fd4079070 con 0x7f0fe406e5f0 2024-08-17T02:28:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.592+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 msgr2=0x7f0fc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.592+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 0x7f0fc0067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4155920 tx=0x7f0fcc007e60 comp rx=0 tx=0).stop 2024-08-17T02:28:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.592+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 msgr2=0x7f0fe40c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.592+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402a7f0 tx=0x7f0fd4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 shutdown_connections 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0fc0065150 0x7f0fc0067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0fe4156d40 0x7f0fe40c0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe4150130 0x7f0fe40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 --2- 172.21.15.46:0/760028951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0fe406e5f0 0x7f0fe40c9570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 >> 172.21.15.46:0/760028951 conn(0x7f0fe4067750 msgr2=0x7f0fe40ac340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 shutdown_connections 2024-08-17T02:28:19.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.593+0000 7f0fe9000640 1 -- 172.21.15.46:0/760028951 wait complete. 2024-08-17T02:28:19.609 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:19.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.764+0000 7f31ee200640 1 Processor -- start 2024-08-17T02:28:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.764+0000 7f31ee200640 1 -- start start 2024-08-17T02:28:19.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ee200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 0x7f31e80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ee200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f31e815c4b0 0x7f31e80aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ee200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80d0a80 con 0x7f31e80b5740 2024-08-17T02:28:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ee200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80b2130 con 0x7f31e815c4b0 2024-08-17T02:28:19.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ee200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e80b23f0 con 0x7f31e80b2bb0 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ed800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f31e815c4b0 0x7f31e80aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ed800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f31e815c4b0 0x7f31e80aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43666/0 (socket says 172.21.15.46:43666) 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.765+0000 7f31ed800640 1 -- 172.21.15.46:0/2827177606 learned_addr learned my addr 172.21.15.46:0/2827177606 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ece00640 1 --2- 172.21.15.46:0/2827177606 >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 0x7f31e80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ed800640 1 -- 172.21.15.46:0/2827177606 >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 msgr2=0x7f31e80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ed800640 1 --2- 172.21.15.46:0/2827177606 >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 0x7f31e80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ed800640 1 -- 172.21.15.46:0/2827177606 >> v1:172.21.15.162:6789/0 conn(0x7f31e80b5740 legacy=0x7f31e815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ed800640 1 -- 172.21.15.46:0/2827177606 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80b37a0 con 0x7f31e815c4b0 2024-08-17T02:28:19.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.766+0000 7f31ece00640 1 --2- 172.21.15.46:0/2827177606 >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 0x7f31e80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:19.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.767+0000 7f31ed800640 1 --2- 172.21.15.46:0/2827177606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e80aac20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31e8070bc0 tx=0x7f31e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dcedc0dd883099 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.767+0000 7f31e7400640 1 -- 172.21.15.46:0/2827177606 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0033430 con 0x7f31e815c4b0 2024-08-17T02:28:19.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.767+0000 7f31e7400640 1 -- 172.21.15.46:0/2827177606 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0033590 con 0x7f31e815c4b0 2024-08-17T02:28:19.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.767+0000 7f31e7400640 1 -- 172.21.15.46:0/2827177606 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0033930 con 0x7f31e815c4b0 2024-08-17T02:28:19.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 -- 172.21.15.46:0/2827177606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 msgr2=0x7f31e80aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 --2- 172.21.15.46:0/2827177606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e80aac20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31e8070bc0 tx=0x7f31e0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 -- 172.21.15.46:0/2827177606 shutdown_connections 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 --2- 172.21.15.46:0/2827177606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e80aac20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 --2- 172.21.15.46:0/2827177606 >> v2:172.21.15.162:3300/0 conn(0x7f31e80b2bb0 0x7f31e80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 -- 172.21.15.46:0/2827177606 >> 172.21.15.46:0/2827177606 conn(0x7f31e80cfbc0 msgr2=0x7f31e80cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 -- 172.21.15.46:0/2827177606 shutdown_connections 2024-08-17T02:28:19.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.768+0000 7f31ee200640 1 -- 172.21.15.46:0/2827177606 wait complete. 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.769+0000 7f31ee200640 1 Processor -- start 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.769+0000 7f31ee200640 1 -- start start 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e80b2bb0 0x7f31e80acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e80b5740 0x7f31e8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8168e90 con 0x7f31e815c4b0 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e809b620 con 0x7f31e80b5740 2024-08-17T02:28:19.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.770+0000 7f31ee200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e809b900 con 0x7f31e80b2bb0 2024-08-17T02:28:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43672/0 (socket says 172.21.15.46:43672) 2024-08-17T02:28:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 -- 172.21.15.46:0/3473333051 learned_addr learned my addr 172.21.15.46:0/3473333051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31e7e00640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e80b5740 0x7f31e8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ece00640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e80b2bb0 0x7f31e80acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 -- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e80b2bb0 msgr2=0x7f31e80acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e80b2bb0 0x7f31e80acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 -- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e80b5740 msgr2=0x7f31e8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e80b5740 0x7f31e8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 -- 172.21.15.46:0/3473333051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009ae0 con 0x7f31e815c4b0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.771+0000 7f31ed800640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31e002ad90 tx=0x7f31e0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.772+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0007b90 con 0x7f31e815c4b0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.772+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0007d10 con 0x7f31e815c4b0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.772+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e003f6c0 con 0x7f31e815c4b0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.772+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e809bbe0 con 0x7f31e815c4b0 2024-08-17T02:28:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.772+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e80ad090 con 0x7f31e815c4b0 2024-08-17T02:28:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.773+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e8169040 con 0x7f31e815c4b0 2024-08-17T02:28:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.774+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e003d420 con 0x7f31e815c4b0 2024-08-17T02:28:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.775+0000 7f31dbe00640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.775+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f31e00a3360 con 0x7f31e815c4b0 2024-08-17T02:28:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.775+0000 7f31ece00640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.776+0000 7f31ece00640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00acc0 tx=0x7f31dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.779+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31e8169040 con 0x7f31e815c4b0 2024-08-17T02:28:19.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:19.959+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31e80ad280 con 0x7f31e815c4b0 2024-08-17T02:28:20.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.592+0000 7f31dbe00640 1 -- 172.21.15.46:0/3473333051 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31e00716f0 con 0x7f31e815c4b0 2024-08-17T02:28:20.593 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 msgr2=0x7f31c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00acc0 tx=0x7f31dc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 msgr2=0x7f31e815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31e002ad90 tx=0x7f31e0037000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 shutdown_connections 2024-08-17T02:28:20.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f31e815c4b0 0x7f31e815a150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e80b5740 0x7f31e8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 --2- 172.21.15.46:0/3473333051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e80b2bb0 0x7f31e80acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 >> 172.21.15.46:0/3473333051 conn(0x7f31e80cfbc0 msgr2=0x7f31e80cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.596+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 shutdown_connections 2024-08-17T02:28:20.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.597+0000 7f31ee200640 1 -- 172.21.15.46:0/3473333051 wait complete. 2024-08-17T02:28:20.616 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:28:20.616 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:28:20.616 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:20.616 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:20.617 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:28:20.617 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:28:20.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:20.617 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:20.617 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:28:20.617 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:28:20.617 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:20.618 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:20.618 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:28:20.618 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:28:20.618 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:20.618 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:20.631 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:20.631 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:28:20.633 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:20.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:28:20.641 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:20.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:28:20.642 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:20.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:28:20.676 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:28:20.676 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:20.680 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:28:20.680 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:20.685 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:28:20.685 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:20.687 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:28:20.688 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:20.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:28:20.806 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-08-17T02:28:20.809 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-08-17T02:28:20.814 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-08-17T02:28:20.814 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-08-17T02:28:20.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.851+0000 7f1ad3e00640 1 Processor -- start 2024-08-17T02:28:20.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.851+0000 7f1ad3e00640 1 -- start start 2024-08-17T02:28:20.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 0x7f1acc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad3e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc156670 con 0x7f1acc155a20 2024-08-17T02:28:20.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc06e5e0 con 0x7f1acc06df00 2024-08-17T02:28:20.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0b0350 con 0x7f1acc155df0 2024-08-17T02:28:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad1400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1acc155a20 0x7f1acc06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42720/0 (socket says 172.21.15.46:42720) 2024-08-17T02:28:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.852+0000 7f1ad1400640 1 -- 172.21.15.46:0/759047492 learned_addr learned my addr 172.21.15.46:0/759047492 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:20.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1ad1e00640 1 --2- 172.21.15.46:0/759047492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 0x7f1acc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485892343 0 0) 0x7f1acc156670 con 0x7f1acc155a20 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab40034e0 con 0x7f1acc155a20 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50502492 0 0) 0x7f1acc06e5e0 con 0x7f1acc06df00 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1acc156670 con 0x7f1acc06df00 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1ad1e00640 1 -- 172.21.15.46:0/759047492 >> v1:172.21.15.162:6789/0 conn(0x7f1acc06df00 legacy=0x7f1acc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1ad1e00640 1 -- 172.21.15.46:0/759047492 >> v1:172.21.15.46:6789/0 conn(0x7f1acc155a20 legacy=0x7f1acc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.853+0000 7f1ad1e00640 1 -- 172.21.15.46:0/759047492 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc06e8c0 con 0x7f1acc155df0 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.854+0000 7f1ad1e00640 1 --2- 172.21.15.46:0/759047492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 0x7f1acc0adf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009e90 tx=0x7f1ac4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f42d8859e46330 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.854+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4007550 con 0x7f1acc155df0 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.854+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac402d050 con 0x7f1acc155df0 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.854+0000 7f1acbe00640 1 -- 172.21.15.46:0/759047492 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40078e0 con 0x7f1acc155df0 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 -- 172.21.15.46:0/759047492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 msgr2=0x7f1acc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/759047492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 0x7f1acc0adf10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009e90 tx=0x7f1ac4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 -- 172.21.15.46:0/759047492 shutdown_connections 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/759047492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155df0 0x7f1acc0adf10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 -- 172.21.15.46:0/759047492 >> 172.21.15.46:0/759047492 conn(0x7f1acc0cb9b0 msgr2=0x7f1acc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 -- 172.21.15.46:0/759047492 shutdown_connections 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.855+0000 7f1ad3e00640 1 -- 172.21.15.46:0/759047492 wait complete. 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.856+0000 7f1ad3e00640 1 Processor -- start 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.857+0000 7f1ad3e00640 1 -- start start 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.857+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 0x7f1acc14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1acc155df0 0x7f1acc1680a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc14d1b0 con 0x7f1acc06df00 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0adee0 con 0x7f1acc155df0 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc149f20 con 0x7f1acc155a20 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39356/0 (socket says 172.21.15.46:39356) 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 -- 172.21.15.46:0/2572553745 learned_addr learned my addr 172.21.15.46:0/2572553745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1acc155df0 0x7f1acc1680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad0a00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 0x7f1acc14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 -- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 msgr2=0x7f1acc14c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 0x7f1acc14c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 -- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1acc155df0 msgr2=0x7f1acc1680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1acc155df0 0x7f1acc1680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad1400640 1 -- 172.21.15.46:0/2572553745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009a20 con 0x7f1acc06df00 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.858+0000 7f1ad0a00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 0x7f1acc14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ad1400640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0005840 tx=0x7f1ac0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0005aa0 con 0x7f1acc06df00 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0005c00 con 0x7f1acc06df00 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00070f0 con 0x7f1acc06df00 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc14a200 con 0x7f1acc06df00 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.859+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc14a7c0 con 0x7f1acc06df00 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.860+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc064db0 con 0x7f1acc06df00 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.861+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1ac0007520 con 0x7f1acc06df00 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.862+0000 7f1ac8c00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 0x7f1aac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.862+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ac0081bf0 con 0x7f1acc06df00 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.862+0000 7f1ad0a00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 0x7f1aac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.863+0000 7f1ad0a00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 0x7f1aac067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0a5d50 tx=0x7f1ab8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:20.866+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1ac004ff90 con 0x7f1acc06df00 2024-08-17T02:28:21.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.061+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1acc15b790 con 0x7f1acc06df00 2024-08-17T02:28:21.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.605+0000 7f1ac8c00640 1 -- 172.21.15.46:0/2572553745 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ac00535b0 con 0x7f1acc06df00 2024-08-17T02:28:21.606 INFO:teuthology.orchestra.run.smithi046.stderr: removed all blocklist entries 2024-08-17T02:28:21.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 msgr2=0x7f1aac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 0x7f1aac067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0a5d50 tx=0x7f1ab8009040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 msgr2=0x7f1acc0ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0005840 tx=0x7f1ac0007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 shutdown_connections 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1acc155df0 0x7f1acc1680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1aac065150 0x7f1aac067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.607+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1acc155a20 0x7f1acc14c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.608+0000 7f1ad3e00640 1 --2- 172.21.15.46:0/2572553745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1acc06df00 0x7f1acc0ad9a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.608+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 >> 172.21.15.46:0/2572553745 conn(0x7f1acc0cb9b0 msgr2=0x7f1acc1548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.608+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 shutdown_connections 2024-08-17T02:28:21.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.608+0000 7f1ad3e00640 1 -- 172.21.15.46:0/2572553745 wait complete. 2024-08-17T02:28:21.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:28:21.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.777+0000 7f40b3400640 1 Processor -- start 2024-08-17T02:28:21.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.777+0000 7f40b3400640 1 -- start start 2024-08-17T02:28:21.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40ac158d60 0x7f40ac0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b3400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f40ac15cb30 0x7f40ac0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b3400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0b18d0 con 0x7f40ac159130 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b3400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0b0d00 con 0x7f40ac158d60 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b3400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0b0fa0 con 0x7f40ac15cb30 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40ac158d60 0x7f40ac0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f40ac158d60 0x7f40ac0b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39366/0 (socket says 172.21.15.46:39366) 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 -- 172.21.15.46:0/2694991801 learned_addr learned my addr 172.21.15.46:0/2694991801 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40a3e00640 1 --2- 172.21.15.46:0/2694991801 >> v2:172.21.15.162:3300/0 conn(0x7f40ac15cb30 0x7f40ac0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 -- 172.21.15.46:0/2694991801 >> v2:172.21.15.162:3300/0 conn(0x7f40ac15cb30 msgr2=0x7f40ac0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 --2- 172.21.15.46:0/2694991801 >> v2:172.21.15.162:3300/0 conn(0x7f40ac15cb30 0x7f40ac0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 -- 172.21.15.46:0/2694991801 >> v1:172.21.15.162:6789/0 conn(0x7f40ac159130 legacy=0x7f40ac0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.779+0000 7f40b0a00640 1 -- 172.21.15.46:0/2694991801 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0b1280 con 0x7f40ac158d60 2024-08-17T02:28:21.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.780+0000 7f40b0a00640 1 --2- 172.21.15.46:0/2694991801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac158d60 0x7f40ac0b1d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f409c009910 tx=0x7f409c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c7e3ab81829af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40abe00640 1 -- 172.21.15.46:0/2694991801 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c02ae70 con 0x7f40ac158d60 2024-08-17T02:28:21.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40abe00640 1 -- 172.21.15.46:0/2694991801 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c032440 con 0x7f40ac158d60 2024-08-17T02:28:21.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40abe00640 1 -- 172.21.15.46:0/2694991801 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c032820 con 0x7f40ac158d60 2024-08-17T02:28:21.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 -- 172.21.15.46:0/2694991801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac158d60 msgr2=0x7f40ac0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 --2- 172.21.15.46:0/2694991801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac158d60 0x7f40ac0b1d60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f409c009910 tx=0x7f409c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 -- 172.21.15.46:0/2694991801 shutdown_connections 2024-08-17T02:28:21.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 --2- 172.21.15.46:0/2694991801 >> v2:172.21.15.162:3300/0 conn(0x7f40ac15cb30 0x7f40ac0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 --2- 172.21.15.46:0/2694991801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac158d60 0x7f40ac0b1d60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 -- 172.21.15.46:0/2694991801 >> 172.21.15.46:0/2694991801 conn(0x7f40ac0b3040 msgr2=0x7f40ac0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 -- 172.21.15.46:0/2694991801 shutdown_connections 2024-08-17T02:28:21.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.781+0000 7f40b3400640 1 -- 172.21.15.46:0/2694991801 wait complete. 2024-08-17T02:28:21.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.783+0000 7f40b3400640 1 Processor -- start 2024-08-17T02:28:21.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.783+0000 7f40b3400640 1 -- start start 2024-08-17T02:28:21.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40ac158d60 0x7f40ac152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40ac159130 0x7f40ac154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac155c60 con 0x7f40ac15cb30 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac155050 con 0x7f40ac159130 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b3400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac155330 con 0x7f40ac158d60 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39378/0 (socket says 172.21.15.46:39378) 2024-08-17T02:28:21.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 -- 172.21.15.46:0/3158117557 learned_addr learned my addr 172.21.15.46:0/3158117557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40a3e00640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40ac159130 0x7f40ac154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b0a00640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40ac158d60 0x7f40ac152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 -- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40ac158d60 msgr2=0x7f40ac152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40ac158d60 0x7f40ac152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 -- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40ac159130 msgr2=0x7f40ac154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40ac159130 0x7f40ac154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.784+0000 7f40b1400640 1 -- 172.21.15.46:0/3158117557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009450 con 0x7f40ac15cb30 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40b1400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c860 tx=0x7f40a4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400ce50 con 0x7f40ac15cb30 2024-08-17T02:28:21.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a400a850 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400ac10 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac155610 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.785+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac152c60 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.786+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac064db0 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.788+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f40a4012630 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.788+0000 7f40a8c00640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.789+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f40a4082280 con 0x7f40ac15cb30 2024-08-17T02:28:21.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.789+0000 7f40b0a00640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.790+0000 7f40b0a00640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 0x7f4088067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f409c034000 tx=0x7f409c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:21.793+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f40a40506a0 con 0x7f40ac15cb30 2024-08-17T02:28:22.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.039+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f40ac069af0 con 0x7f40ac15cb30 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.039+0000 7f40a8c00640 1 -- 172.21.15.46:0/3158117557 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f40a4053cc0 con 0x7f40ac15cb30 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "auth_dump": [ 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.a", 2024-08-17T02:28:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBmCsBmrXWWKxAAdVrIugKIdj3GLyukSDGh+A==", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.b", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBmo6PmAhAACwLo/s6gKBZD4QmCb11YIA==", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.041 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.c", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBmCsBmJmQJNRAAoRZ1wZaOEIszQNIBR83rHg==", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-08-17T02:28:22.042 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mds.d", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBmLjtfDBAA4kuCETIapveiTwbRdb/8Dg==", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.043 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.0", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBoCsBmHs9jORAANOS/jokpQP2pK8jLIjAgIw==", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.1", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBsCsBmKdf7ARAAq9Q37E3Hl0ukp5bUcxkNcQ==", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.044 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.2", 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBvCsBmH7BMBRAA60UxxwS/JA6/XmWeiw13rg==", 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.045 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.3", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQByCsBm37PyCBAAXtfOPCbWHHrU+gd0L5hrEg==", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.4", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB3CsBmu4FnORAAlaghmbp2rjtE6iSWqa2OqQ==", 2024-08-17T02:28:22.046 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.5", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB7CsBmQjD9ABAA2TRswJ+m2zspGKKNUhbEOQ==", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.047 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.6", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQB+CsBmkwfrAxAAXRkLIQV0vtcL3N0rfI569A==", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "osd.7", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCBCsBmQt3JBhAAXaALqFhWUNounntsvosqnw==", 2024-08-17T02:28:22.048 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile osd", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.0", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBmzn+JFBAASPIzKn+yOLLZFpT6Mly4wg==", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-08-17T02:28:22.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.1", 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBmPlStIBAAqXgQfLQJMU6LSR+J1eJgow==", 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.050 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.2", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBm7EeYGhAADKlp+1XFbuWrfn1X0zeu7Q==", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.3", 2024-08-17T02:28:22.051 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBnCsBmsWi2JhAAhx2GJK6dvPOtMwgY1sGQ9A==", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow r", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow rw", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow rwx" 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.admin", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBlCsBmUNvgOBAAXW3OFQMB3tYv93qgUtzhXg==", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-08-17T02:28:22.052 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": "allow *", 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow *", 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmWsqoHBAAcpZqPsb/YmK1z5QU2KqCEQ==", 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmXtSoHBAAdnlGUJ93y71v/lwKFPfUiQ==", 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.054 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmp9yoHBAAlV+8MgJEJg7OHNPCHv+KlA==", 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmDuWoHBAAxWVsTipk/guDGp8SVZMCEA==", 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.055 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmHu+oHBAA3wF1tcSGfQes0qEubICzGQ==", 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQCICsBmvfeoHBAAsXp2cIIEwtdeRC1u99X/0g==", 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.056 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.x", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBmCsBmyAFbJRAAf/MO8LhtNIa8OnEBb2wOUQ==", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "entity": "mgr.y", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "key": "AQBmCsBmonHVHhAAxNV3AwTtq0ZbzTdn6uyz9w==", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": { 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": "allow *", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:22.057 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": "allow *" 2024-08-17T02:28:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:22.058 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-08-17T02:28:22.058 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:28:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 msgr2=0x7f4088067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 0x7f4088067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f409c034000 tx=0x7f409c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 msgr2=0x7f40ac156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c860 tx=0x7f40a4001690 comp rx=0 tx=0).stop 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 shutdown_connections 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40ac15cb30 0x7f40ac156690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40ac159130 0x7f40ac154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 --2- 172.21.15.46:0/3158117557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40ac158d60 0x7f40ac152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 >> 172.21.15.46:0/3158117557 conn(0x7f40ac0b3040 msgr2=0x7f40ac152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 shutdown_connections 2024-08-17T02:28:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.041+0000 7f40b3400640 1 -- 172.21.15.46:0/3158117557 wait complete. 2024-08-17T02:28:22.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:28:22.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.212+0000 7fe57a800640 1 Processor -- start 2024-08-17T02:28:22.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.212+0000 7fe57a800640 1 -- start start 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5741401b0 0x7fe5740caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe574140580 0x7fe5740b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5740b1270 0x7fe5740c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5740cb450 con 0x7fe574140580 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5740b16d0 con 0x7fe5740b1270 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe57a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740caa80 con 0x7fe5741401b0 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.213+0000 7fe572a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe574140580 0x7fe5740b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe574140580 0x7fe5740b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39388/0 (socket says 172.21.15.46:39388) 2024-08-17T02:28:22.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 -- 172.21.15.46:0/2796485519 learned_addr learned my addr 172.21.15.46:0/2796485519 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe573400640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5741401b0 0x7fe5740caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe573e00640 1 --2- 172.21.15.46:0/2796485519 >> v2:172.21.15.162:3300/0 conn(0x7fe5740b1270 0x7fe5740c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 -- 172.21.15.46:0/2796485519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5741401b0 msgr2=0x7fe5740caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5741401b0 0x7fe5740caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 -- 172.21.15.46:0/2796485519 >> v2:172.21.15.162:3300/0 conn(0x7fe5740b1270 msgr2=0x7fe5740c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 --2- 172.21.15.46:0/2796485519 >> v2:172.21.15.162:3300/0 conn(0x7fe5740b1270 0x7fe5740c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.214+0000 7fe572a00640 1 -- 172.21.15.46:0/2796485519 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740c9e70 con 0x7fe574140580 2024-08-17T02:28:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.215+0000 7fe572a00640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe574140580 0x7fe5740b0d30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe5740acbc0 tx=0x7fe5600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7d4800041095e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.215+0000 7fe572000640 1 -- 172.21.15.46:0/2796485519 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56002ad40 con 0x7fe574140580 2024-08-17T02:28:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.215+0000 7fe572000640 1 -- 172.21.15.46:0/2796485519 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560032440 con 0x7fe574140580 2024-08-17T02:28:22.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.215+0000 7fe572000640 1 -- 172.21.15.46:0/2796485519 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56002aea0 con 0x7fe574140580 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 -- 172.21.15.46:0/2796485519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe574140580 msgr2=0x7fe5740b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe574140580 0x7fe5740b0d30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe5740acbc0 tx=0x7fe5600091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 -- 172.21.15.46:0/2796485519 shutdown_connections 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 --2- 172.21.15.46:0/2796485519 >> v2:172.21.15.162:3300/0 conn(0x7fe5740b1270 0x7fe5740c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe574140580 0x7fe5740b0d30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 --2- 172.21.15.46:0/2796485519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5741401b0 0x7fe5740caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 -- 172.21.15.46:0/2796485519 >> 172.21.15.46:0/2796485519 conn(0x7fe5740cb9b0 msgr2=0x7fe5740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 -- 172.21.15.46:0/2796485519 shutdown_connections 2024-08-17T02:28:22.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.216+0000 7fe57a800640 1 -- 172.21.15.46:0/2796485519 wait complete. 2024-08-17T02:28:22.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.217+0000 7fe57a800640 1 Processor -- start 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.217+0000 7fe57a800640 1 -- start start 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5740b1270 0x7fe5741582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574140580 0x7fe57413a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57415c760 con 0x7fe5741401b0 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57413a5f0 con 0x7fe5740b1270 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe57a800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57416ab40 con 0x7fe574140580 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.218+0000 7fe572a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39394/0 (socket says 172.21.15.46:39394) 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 -- 172.21.15.46:0/2910338106 learned_addr learned my addr 172.21.15.46:0/2910338106 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:22.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe573400640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5740b1270 0x7fe5741582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe573e00640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574140580 0x7fe57413a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 -- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574140580 msgr2=0x7fe57413a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574140580 0x7fe57413a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 -- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5740b1270 msgr2=0x7fe5741582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5740b1270 0x7fe5741582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 -- 172.21.15.46:0/2910338106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009450 con 0x7fe5741401b0 2024-08-17T02:28:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.219+0000 7fe572a00640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe560009210 tx=0x7fe560032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.220+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560032700 con 0x7fe5741401b0 2024-08-17T02:28:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.220+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560031a60 con 0x7fe5741401b0 2024-08-17T02:28:22.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.220+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560031e60 con 0x7fe5741401b0 2024-08-17T02:28:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.220+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574169f50 con 0x7fe5741401b0 2024-08-17T02:28:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.220+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57416a7d0 con 0x7fe5741401b0 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.221+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57416acf0 con 0x7fe5741401b0 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.222+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe560039040 con 0x7fe5741401b0 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.222+0000 7fe56aa00640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 0x7fe554067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.222+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5600a1b80 con 0x7fe5741401b0 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.223+0000 7fe573400640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 0x7fe554067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.223+0000 7fe573400640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 0x7fe554067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe564007ba0 tx=0x7fe564008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.226+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe57416acf0 con 0x7fe5741401b0 2024-08-17T02:28:22.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.483+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe57416acb0 con 0x7fe5741401b0 2024-08-17T02:28:22.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.486+0000 7fe56aa00640 1 -- 172.21.15.46:0/2910338106 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe5600370a0 con 0x7fe5741401b0 2024-08-17T02:28:22.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 msgr2=0x7fe554067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 0x7fe554067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe564007ba0 tx=0x7fe564008040 comp rx=0 tx=0).stop 2024-08-17T02:28:22.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 msgr2=0x7fe574139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe560009210 tx=0x7fe560032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 shutdown_connections 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe554065150 0x7fe554067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe574140580 0x7fe57413a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5741401b0 0x7fe574139b70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 --2- 172.21.15.46:0/2910338106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5740b1270 0x7fe5741582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 >> 172.21.15.46:0/2910338106 conn(0x7fe5740cb9b0 msgr2=0x7fe5740afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 shutdown_connections 2024-08-17T02:28:22.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.489+0000 7fe57a800640 1 -- 172.21.15.46:0/2910338106 wait complete. 2024-08-17T02:28:22.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:28:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.658+0000 7fa154800640 1 Processor -- start 2024-08-17T02:28:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.658+0000 7fa154800640 1 -- start start 2024-08-17T02:28:22.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.659+0000 7fa154800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.659+0000 7fa154800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa14c06df00 0x7fa14c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.659+0000 7fa154800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c156670 con 0x7fa14c155df0 2024-08-17T02:28:22.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.659+0000 7fa154800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c0b0350 con 0x7fa14c06df00 2024-08-17T02:28:22.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.659+0000 7fa154800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c06e5e0 con 0x7fa14c155a20 2024-08-17T02:28:22.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.660+0000 7fa151e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.660+0000 7fa152800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa14c06df00 0x7fa14c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.660+0000 7fa151e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:35436/0 (socket says 172.21.15.46:35436) 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.660+0000 7fa151e00640 1 -- 172.21.15.46:0/3870770592 learned_addr learned my addr 172.21.15.46:0/3870770592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.660+0000 7fa151400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa14c155df0 0x7fa14c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45080/0 (socket says 172.21.15.46:45080) 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.661+0000 7fa151e00640 1 -- 172.21.15.46:0/3870770592 >> v2:172.21.15.162:3300/0 conn(0x7fa14c06df00 msgr2=0x7fa14c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.661+0000 7fa151e00640 1 --2- 172.21.15.46:0/3870770592 >> v2:172.21.15.162:3300/0 conn(0x7fa14c06df00 0x7fa14c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.661+0000 7fa151e00640 1 -- 172.21.15.46:0/3870770592 >> v1:172.21.15.162:6789/0 conn(0x7fa14c155df0 legacy=0x7fa14c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.661+0000 7fa151e00640 1 -- 172.21.15.46:0/3870770592 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c06e8c0 con 0x7fa14c155a20 2024-08-17T02:28:22.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.661+0000 7fa150a00640 1 -- 172.21.15.46:0/3870770592 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382001673 0 0) 0x7fa14c156670 con 0x7fa14c155df0 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.662+0000 7fa151e00640 1 --2- 172.21.15.46:0/3870770592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa140009910 tx=0x7fa1400091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c05d1edec1ba1d9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.662+0000 7fa150a00640 1 -- 172.21.15.46:0/3870770592 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002ae40 con 0x7fa14c155a20 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.662+0000 7fa150a00640 1 -- 172.21.15.46:0/3870770592 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140032440 con 0x7fa14c155a20 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.662+0000 7fa150a00640 1 -- 172.21.15.46:0/3870770592 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400327e0 con 0x7fa14c155a20 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 -- 172.21.15.46:0/3870770592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 msgr2=0x7fa14c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 --2- 172.21.15.46:0/3870770592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa140009910 tx=0x7fa1400091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 -- 172.21.15.46:0/3870770592 shutdown_connections 2024-08-17T02:28:22.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 --2- 172.21.15.46:0/3870770592 >> v2:172.21.15.162:3300/0 conn(0x7fa14c06df00 0x7fa14c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 --2- 172.21.15.46:0/3870770592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155a20 0x7fa14c0adf10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 -- 172.21.15.46:0/3870770592 >> 172.21.15.46:0/3870770592 conn(0x7fa14c0cb9b0 msgr2=0x7fa14c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 -- 172.21.15.46:0/3870770592 shutdown_connections 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.663+0000 7fa154800640 1 -- 172.21.15.46:0/3870770592 wait complete. 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.664+0000 7fa154800640 1 Processor -- start 2024-08-17T02:28:22.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.664+0000 7fa154800640 1 -- start start 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa14c06df00 0x7fa14c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155df0 0x7fa14c069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c14e5c0 con 0x7fa14c155a20 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c0a69f0 con 0x7fa14c06df00 2024-08-17T02:28:22.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa154800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c14e7b0 con 0x7fa14c155df0 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.665+0000 7fa151400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa14c06df00 0x7fa14c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa152800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155df0 0x7fa14c069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39404/0 (socket says 172.21.15.46:39404) 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 -- 172.21.15.46:0/4245875115 learned_addr learned my addr 172.21.15.46:0/4245875115 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 -- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155df0 msgr2=0x7fa14c069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155df0 0x7fa14c069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 -- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa14c06df00 msgr2=0x7fa14c14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa14c06df00 0x7fa14c14e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 -- 172.21.15.46:0/4245875115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140009450 con 0x7fa14c155a20 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.666+0000 7fa151400640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0017d0 tx=0x7fa13c00e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.667+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c013070 con 0x7fa14c155a20 2024-08-17T02:28:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.667+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13c00e2e0 con 0x7fa14c155a20 2024-08-17T02:28:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.667+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13c007320 con 0x7fa14c155a20 2024-08-17T02:28:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.667+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c14ea90 con 0x7fa14c155a20 2024-08-17T02:28:22.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.667+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c14f330 con 0x7fa14c155a20 2024-08-17T02:28:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.668+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14c14f580 con 0x7fa14c155a20 2024-08-17T02:28:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.669+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa13c0047a0 con 0x7fa14c155a20 2024-08-17T02:28:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.670+0000 7fa145600640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 0x7fa130067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.670+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa13c085860 con 0x7fa14c155a20 2024-08-17T02:28:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.670+0000 7fa151e00640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 0x7fa130067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.671+0000 7fa151e00640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 0x7fa130067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa140034000 tx=0x7fa140032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.674+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa13c053d00 con 0x7fa14c155a20 2024-08-17T02:28:22.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.924+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa14c064db0 con 0x7fa14c155a20 2024-08-17T02:28:22.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.928+0000 7fa145600640 1 -- 172.21.15.46:0/4245875115 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa13c057320 con 0x7fa14c155a20 2024-08-17T02:28:22.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 msgr2=0x7fa130067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 0x7fa130067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa140034000 tx=0x7fa140032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 msgr2=0x7fa14c0a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa13c0017d0 tx=0x7fa13c00e470 comp rx=0 tx=0).stop 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 shutdown_connections 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa130065150 0x7fa130067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa14c155df0 0x7fa14c069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa14c155a20 0x7fa14c0a64b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 --2- 172.21.15.46:0/4245875115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa14c06df00 0x7fa14c14e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 >> 172.21.15.46:0/4245875115 conn(0x7fa14c0cb9b0 msgr2=0x7fa14c06d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 shutdown_connections 2024-08-17T02:28:22.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:22.930+0000 7fa154800640 1 -- 172.21.15.46:0/4245875115 wait complete. 2024-08-17T02:28:22.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:28:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.098+0000 7fbf6d800640 1 Processor -- start 2024-08-17T02:28:23.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.098+0000 7fbf6d800640 1 -- start start 2024-08-17T02:28:23.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf6d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbf68158cb0 0x7fbf680af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf6d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf6d800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680abc80 con 0x7fbf680aa910 2024-08-17T02:28:23.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf6d800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680ab070 con 0x7fbf68158cb0 2024-08-17T02:28:23.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf6d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680ab350 con 0x7fbf680ac820 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf5fe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbf680aa910 0x7fbf680ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42734/0 (socket says 172.21.15.46:42734) 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.099+0000 7fbf5fe00640 1 -- 172.21.15.46:0/3355616865 learned_addr learned my addr 172.21.15.46:0/3355616865 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66a00640 1 --2- 172.21.15.46:0/3355616865 >> v2:172.21.15.162:3300/0 conn(0x7fbf68158cb0 0x7fbf680af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf67400640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66000640 1 -- 172.21.15.46:0/3355616865 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339218787 0 0) 0x7fbf680abc80 con 0x7fbf680aa910 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66000640 1 -- 172.21.15.46:0/3355616865 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf4c0034e0 con 0x7fbf680aa910 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66a00640 1 -- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 msgr2=0x7fbf68159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66a00640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66a00640 1 -- 172.21.15.46:0/3355616865 >> v1:172.21.15.46:6789/0 conn(0x7fbf680aa910 legacy=0x7fbf680ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.100+0000 7fbf66a00640 1 -- 172.21.15.46:0/3355616865 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680ab630 con 0x7fbf68158cb0 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.101+0000 7fbf66a00640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf68158cb0 0x7fbf680af6d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009850 tx=0x7fbf580090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda47a64dc30d618 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf66000640 1 -- 172.21.15.46:0/3355616865 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5802ad80 con 0x7fbf68158cb0 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf66000640 1 -- 172.21.15.46:0/3355616865 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58032440 con 0x7fbf68158cb0 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf66000640 1 -- 172.21.15.46:0/3355616865 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58032820 con 0x7fbf68158cb0 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 -- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf68158cb0 msgr2=0x7fbf680af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf68158cb0 0x7fbf680af6d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009850 tx=0x7fbf580090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 -- 172.21.15.46:0/3355616865 shutdown_connections 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 --2- 172.21.15.46:0/3355616865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf68158cb0 0x7fbf680af6d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 -- 172.21.15.46:0/3355616865 >> 172.21.15.46:0/3355616865 conn(0x7fbf68096a70 msgr2=0x7fbf68096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 -- 172.21.15.46:0/3355616865 shutdown_connections 2024-08-17T02:28:23.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.102+0000 7fbf6d800640 1 -- 172.21.15.46:0/3355616865 wait complete. 2024-08-17T02:28:23.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.104+0000 7fbf6d800640 1 Processor -- start 2024-08-17T02:28:23.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.104+0000 7fbf6d800640 1 -- start start 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf680aa910 0x7fbf68168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680b22f0 con 0x7fbf68158cb0 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680b1a30 con 0x7fbf680aa910 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf6d800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680b1ca0 con 0x7fbf680ac820 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39418/0 (socket says 172.21.15.46:39418) 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 -- 172.21.15.46:0/819119600 learned_addr learned my addr 172.21.15.46:0/819119600 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf66a00640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf680aa910 0x7fbf68168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf5fe00640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 -- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 msgr2=0x7fbf68152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 -- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf680aa910 msgr2=0x7fbf68168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf680aa910 0x7fbf68168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.105+0000 7fbf67400640 1 -- 172.21.15.46:0/819119600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58009390 con 0x7fbf68158cb0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf67400640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009e90 tx=0x7fbf6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6000ce10 con 0x7fbf68158cb0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6000f040 con 0x7fbf68158cb0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf680b1f80 con 0x7fbf68158cb0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600146d0 con 0x7fbf68158cb0 2024-08-17T02:28:23.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.106+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6815a2c0 con 0x7fbf68158cb0 2024-08-17T02:28:23.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.107+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf680b2460 con 0x7fbf68158cb0 2024-08-17T02:28:23.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.108+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf60014a80 con 0x7fbf68158cb0 2024-08-17T02:28:23.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.109+0000 7fbf5e000640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 0x7fbf44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.109+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbf60082ce0 con 0x7fbf68158cb0 2024-08-17T02:28:23.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.109+0000 7fbf66a00640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 0x7fbf44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.110+0000 7fbf66a00640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 0x7fbf44067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbf58034000 tx=0x7fbf58032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.113+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf60054ae0 con 0x7fbf68158cb0 2024-08-17T02:28:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.362+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fbf68064db0 con 0x7fbf68158cb0 2024-08-17T02:28:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.366+0000 7fbf5e000640 1 -- 172.21.15.46:0/819119600 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbf60054670 con 0x7fbf68158cb0 2024-08-17T02:28:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 msgr2=0x7fbf44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 0x7fbf44067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbf58034000 tx=0x7fbf58032000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 msgr2=0x7fbf68159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009e90 tx=0x7fbf6000b040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 shutdown_connections 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf68158cb0 0x7fbf68159920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbf44065150 0x7fbf44067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf680ac820 0x7fbf68152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 --2- 172.21.15.46:0/819119600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf680aa910 0x7fbf68168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 >> 172.21.15.46:0/819119600 conn(0x7fbf68096a70 msgr2=0x7fbf68155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 shutdown_connections 2024-08-17T02:28:23.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.368+0000 7fbf6d800640 1 -- 172.21.15.46:0/819119600 wait complete. 2024-08-17T02:28:23.384 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:28:23.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.535+0000 7f4a6c600640 1 Processor -- start 2024-08-17T02:28:23.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.535+0000 7f4a6c600640 1 -- start start 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.536+0000 7f4a6c600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a6406da20 0x7f4a6406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.536+0000 7f4a6c600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a64158fa0 0x7f4a640ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.536+0000 7f4a6c600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a640a9a10 con 0x7f4a640aa7d0 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.536+0000 7f4a6c600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a640ac400 con 0x7f4a6406da20 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.536+0000 7f4a6c600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640a9cf0 con 0x7f4a64158fa0 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a6406da20 0x7f4a6406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a6a600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a64158fa0 0x7f4a640ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a6406da20 0x7f4a6406ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:36214/0 (socket says 172.21.15.46:36214) 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 -- 172.21.15.46:0/2806753536 learned_addr learned my addr 172.21.15.46:0/2806753536 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:23.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69200640 1 --1- 172.21.15.46:0/2806753536 >> v1:172.21.15.162:6789/0 conn(0x7f4a640aa7d0 0x7f4a64158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45086/0 (socket says 172.21.15.46:45086) 2024-08-17T02:28:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 -- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a64158fa0 msgr2=0x7f4a640ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 --2- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a64158fa0 0x7f4a640ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 -- 172.21.15.46:0/2806753536 >> v1:172.21.15.162:6789/0 conn(0x7f4a640aa7d0 legacy=0x7f4a64158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a63e00640 1 -- 172.21.15.46:0/2806753536 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696197102 0 0) 0x7f4a640a9a10 con 0x7f4a640aa7d0 2024-08-17T02:28:23.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.537+0000 7f4a69c00640 1 -- 172.21.15.46:0/2806753536 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640a9fd0 con 0x7f4a6406da20 2024-08-17T02:28:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.539+0000 7f4a69c00640 1 --2- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a6406da20 0x7f4a6406ddf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009910 tx=0x7f4a580091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a89e39dfb62728 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.539+0000 7f4a63e00640 1 -- 172.21.15.46:0/2806753536 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5802adb0 con 0x7f4a6406da20 2024-08-17T02:28:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.539+0000 7f4a63e00640 1 -- 172.21.15.46:0/2806753536 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58032440 con 0x7f4a6406da20 2024-08-17T02:28:23.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.539+0000 7f4a63e00640 1 -- 172.21.15.46:0/2806753536 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58032820 con 0x7f4a6406da20 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 -- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a6406da20 msgr2=0x7f4a6406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 --2- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a6406da20 0x7f4a6406ddf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009910 tx=0x7f4a580091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 -- 172.21.15.46:0/2806753536 shutdown_connections 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 --2- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a64158fa0 0x7f4a640ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 --2- 172.21.15.46:0/2806753536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a6406da20 0x7f4a6406ddf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 -- 172.21.15.46:0/2806753536 >> 172.21.15.46:0/2806753536 conn(0x7f4a640cb9b0 msgr2=0x7f4a640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 -- 172.21.15.46:0/2806753536 shutdown_connections 2024-08-17T02:28:23.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.540+0000 7f4a6c600640 1 -- 172.21.15.46:0/2806753536 wait complete. 2024-08-17T02:28:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.541+0000 7f4a6c600640 1 Processor -- start 2024-08-17T02:28:23.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.541+0000 7f4a6c600640 1 -- start start 2024-08-17T02:28:23.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a6406da20 0x7f4a6406a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 0x7f4a64168f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64169f10 con 0x7f4a64158fa0 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64169950 con 0x7f4a640aa7d0 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6c600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64169c30 con 0x7f4a6406da20 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.542+0000 7f4a6a600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39424/0 (socket says 172.21.15.46:39424) 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 -- 172.21.15.46:0/1865964661 learned_addr learned my addr 172.21.15.46:0/1865964661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a69c00640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a6406da20 0x7f4a6406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a69200640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 0x7f4a64168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 -- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a6406da20 msgr2=0x7f4a6406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a6406da20 0x7f4a6406a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 -- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 msgr2=0x7f4a64168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 0x7f4a64168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 -- 172.21.15.46:0/1865964661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58009450 con 0x7f4a64158fa0 2024-08-17T02:28:23.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a69200640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 0x7f4a64168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a6a600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009df0 tx=0x7f4a5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c00cd40 con 0x7f4a64158fa0 2024-08-17T02:28:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00f040 con 0x7f4a64158fa0 2024-08-17T02:28:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.543+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0146d0 con 0x7f4a64158fa0 2024-08-17T02:28:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.544+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6416c710 con 0x7f4a64158fa0 2024-08-17T02:28:23.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.544+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6406a6a0 con 0x7f4a64158fa0 2024-08-17T02:28:23.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.545+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6416c570 con 0x7f4a64158fa0 2024-08-17T02:28:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.546+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a5c014a80 con 0x7f4a64158fa0 2024-08-17T02:28:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.547+0000 7f4a60c00640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 0x7f4a44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.547+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4a5c082bd0 con 0x7f4a64158fa0 2024-08-17T02:28:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.547+0000 7f4a69c00640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 0x7f4a44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.548+0000 7f4a69c00640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 0x7f4a44067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a58034000 tx=0x7f4a58032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.551+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a6416c570 con 0x7f4a64158fa0 2024-08-17T02:28:23.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.802+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4a6416c570 con 0x7f4a64158fa0 2024-08-17T02:28:23.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.806+0000 7f4a60c00640 1 -- 172.21.15.46:0/1865964661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4a6416c570 con 0x7f4a64158fa0 2024-08-17T02:28:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 msgr2=0x7f4a44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 0x7f4a44067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a58034000 tx=0x7f4a58032000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 msgr2=0x7f4a64146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009df0 tx=0x7f4a5c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 shutdown_connections 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a64158fa0 0x7f4a64146050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a640aa7d0 0x7f4a64168f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4a44065150 0x7f4a44067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 --2- 172.21.15.46:0/1865964661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a6406da20 0x7f4a6406a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 >> 172.21.15.46:0/1865964661 conn(0x7f4a640cb9b0 msgr2=0x7f4a640b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 shutdown_connections 2024-08-17T02:28:23.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.808+0000 7f4a6c600640 1 -- 172.21.15.46:0/1865964661 wait complete. 2024-08-17T02:28:23.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:28:23.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.975+0000 7fc17e200640 1 Processor -- start 2024-08-17T02:28:23.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.976+0000 7fc17e200640 1 -- start start 2024-08-17T02:28:23.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc17e200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc178155a20 0x7fc1780adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc17e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc17e200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc178156670 con 0x7fc178155df0 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc17e200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780b0350 con 0x7fc178155a20 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc17e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17806e5e0 con 0x7fc17806df00 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc177400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc178155a20 0x7fc1780adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc177400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc178155a20 0x7fc1780adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39432/0 (socket says 172.21.15.46:39432) 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc177400640 1 -- 172.21.15.46:0/3133926882 learned_addr learned my addr 172.21.15.46:0/3133926882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.977+0000 7fc177e00640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.978+0000 7fc177400640 1 -- 172.21.15.46:0/3133926882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 msgr2=0x7fc1780ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.978+0000 7fc177400640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.978+0000 7fc177400640 1 -- 172.21.15.46:0/3133926882 >> v1:172.21.15.162:6789/0 conn(0x7fc178155df0 legacy=0x7fc17806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.978+0000 7fc177400640 1 -- 172.21.15.46:0/3133926882 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17806e8c0 con 0x7fc178155a20 2024-08-17T02:28:23.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.978+0000 7fc177e00640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc177400640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc1780adf10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc168009910 tx=0x7fc1680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139e54a73116430c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc176a00640 1 -- 172.21.15.46:0/3133926882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16802ae40 con 0x7fc178155a20 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc176a00640 1 -- 172.21.15.46:0/3133926882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168032440 con 0x7fc178155a20 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc176a00640 1 -- 172.21.15.46:0/3133926882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168032820 con 0x7fc178155a20 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc17e200640 1 -- 172.21.15.46:0/3133926882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 msgr2=0x7fc1780adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.979+0000 7fc17e200640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc1780adf10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc168009910 tx=0x7fc1680091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 -- 172.21.15.46:0/3133926882 shutdown_connections 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 --2- 172.21.15.46:0/3133926882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc1780adf10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 -- 172.21.15.46:0/3133926882 >> 172.21.15.46:0/3133926882 conn(0x7fc1780cb9b0 msgr2=0x7fc1780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 -- 172.21.15.46:0/3133926882 shutdown_connections 2024-08-17T02:28:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.980+0000 7fc17e200640 1 -- 172.21.15.46:0/3133926882 wait complete. 2024-08-17T02:28:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.981+0000 7fc17e200640 1 Processor -- start 2024-08-17T02:28:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.981+0000 7fc17e200640 1 -- start start 2024-08-17T02:28:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 0x7fc17814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780a9e20 con 0x7fc178155a20 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178150870 con 0x7fc178155df0 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc17e200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17814dd70 con 0x7fc17806df00 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc16fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc16fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39440/0 (socket says 172.21.15.46:39440) 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.982+0000 7fc16fe00640 1 -- 172.21.15.46:0/1832303185 learned_addr learned my addr 172.21.15.46:0/1832303185 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc177400640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc177e00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 0x7fc17814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 -- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 msgr2=0x7fc1780a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 -- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 msgr2=0x7fc17814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 0x7fc17814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 -- 172.21.15.46:0/1832303185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168009450 con 0x7fc178155a20 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc177e00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 0x7fc17814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16fe00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c490 tx=0x7fc160007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160011590 con 0x7fc178155a20 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160011710 con 0x7fc178155a20 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc160011ad0 con 0x7fc178155a20 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.983+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17814e050 con 0x7fc178155a20 2024-08-17T02:28:23.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.984+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17814e610 con 0x7fc178155a20 2024-08-17T02:28:23.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.985+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178064db0 con 0x7fc178155a20 2024-08-17T02:28:23.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.985+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc16001b3b0 con 0x7fc178155a20 2024-08-17T02:28:23.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.986+0000 7fc16ea00640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.986+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc160081550 con 0x7fc178155a20 2024-08-17T02:28:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.987+0000 7fc177400640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.987+0000 7fc177400640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 0x7fc154067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc168034000 tx=0x7fc168032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:23.990+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc16004f960 con 0x7fc178155a20 2024-08-17T02:28:24.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.241+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc1780a9f60 con 0x7fc178155a20 2024-08-17T02:28:24.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.245+0000 7fc16ea00640 1 -- 172.21.15.46:0/1832303185 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc1600170a0 con 0x7fc178155a20 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 msgr2=0x7fc154067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 0x7fc154067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc168034000 tx=0x7fc168032000 comp rx=0 tx=0).stop 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 msgr2=0x7fc178168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc16000c490 tx=0x7fc160007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 shutdown_connections 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc178155df0 0x7fc17814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc178155a20 0x7fc178168970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc154065150 0x7fc154067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 --2- 172.21.15.46:0/1832303185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc17806df00 0x7fc1780a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 >> 172.21.15.46:0/1832303185 conn(0x7fc1780cb9b0 msgr2=0x7fc1780687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 shutdown_connections 2024-08-17T02:28:24.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.247+0000 7fc17e200640 1 -- 172.21.15.46:0/1832303185 wait complete. 2024-08-17T02:28:24.262 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:28:24.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.413+0000 7fbb8c800640 1 Processor -- start 2024-08-17T02:28:24.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.413+0000 7fbb8c800640 1 -- start start 2024-08-17T02:28:24.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.414+0000 7fbb8c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb840b1440 0x7fbb840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.414+0000 7fbb8c800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb84140580 0x7fbb840c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.414+0000 7fbb8c800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840caa80 con 0x7fbb841401b0 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.414+0000 7fbb8c800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840cb450 con 0x7fbb84140580 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.414+0000 7fbb8c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840c9e70 con 0x7fbb840b1440 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb84140580 0x7fbb840c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbb84140580 0x7fbb840c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39452/0 (socket says 172.21.15.46:39452) 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 -- 172.21.15.46:0/1711385558 learned_addr learned my addr 172.21.15.46:0/1711385558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:24.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb89400640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb840b1440 0x7fbb840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 -- 172.21.15.46:0/1711385558 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb840b1440 msgr2=0x7fbb840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb840b1440 0x7fbb840caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 -- 172.21.15.46:0/1711385558 >> v1:172.21.15.162:6789/0 conn(0x7fbb841401b0 legacy=0x7fbb840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.415+0000 7fbb8a800640 1 -- 172.21.15.46:0/1711385558 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840ca150 con 0x7fbb84140580 2024-08-17T02:28:24.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.416+0000 7fbb8a800640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb84140580 0x7fbb840c9040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009f20 tx=0x7fbb80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c86ec8aaaad1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.416+0000 7fbb88a00640 1 -- 172.21.15.46:0/1711385558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80031400 con 0x7fbb84140580 2024-08-17T02:28:24.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.416+0000 7fbb88a00640 1 -- 172.21.15.46:0/1711385558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8002d050 con 0x7fbb84140580 2024-08-17T02:28:24.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.416+0000 7fbb88a00640 1 -- 172.21.15.46:0/1711385558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800317d0 con 0x7fbb84140580 2024-08-17T02:28:24.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 -- 172.21.15.46:0/1711385558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb84140580 msgr2=0x7fbb840c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb84140580 0x7fbb840c9040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009f20 tx=0x7fbb80009840 comp rx=0 tx=0).stop 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 -- 172.21.15.46:0/1711385558 shutdown_connections 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb84140580 0x7fbb840c9040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1711385558 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb840b1440 0x7fbb840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 -- 172.21.15.46:0/1711385558 >> 172.21.15.46:0/1711385558 conn(0x7fbb840cb9b0 msgr2=0x7fbb840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 -- 172.21.15.46:0/1711385558 shutdown_connections 2024-08-17T02:28:24.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.417+0000 7fbb8c800640 1 -- 172.21.15.46:0/1711385558 wait complete. 2024-08-17T02:28:24.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.419+0000 7fbb8c800640 1 Processor -- start 2024-08-17T02:28:24.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.419+0000 7fbb8c800640 1 -- start start 2024-08-17T02:28:24.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 0x7fbb84158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 0x7fbb8415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8413c710 con 0x7fbb841401b0 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8413bb00 con 0x7fbb840b1440 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8413bde0 con 0x7fbb84140580 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39464/0 (socket says 172.21.15.46:39464) 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 -- 172.21.15.46:0/1376232467 learned_addr learned my addr 172.21.15.46:0/1376232467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89e00640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 0x7fbb84158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8a800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 0x7fbb8415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 -- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 msgr2=0x7fbb8415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 0x7fbb8415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 -- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 msgr2=0x7fbb84158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 0x7fbb84158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89400640 1 -- 172.21.15.46:0/1376232467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009ae0 con 0x7fbb841401b0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb89e00640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 0x7fbb84158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.420+0000 7fbb8a800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 0x7fbb8415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb89400640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400e900 tx=0x7fbb740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400c8e0 con 0x7fbb841401b0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400ca40 con 0x7fbb841401b0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400cde0 con 0x7fbb841401b0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8413c0c0 con 0x7fbb841401b0 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.421+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb84158eb0 con 0x7fbb841401b0 2024-08-17T02:28:24.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.422+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8413c8c0 con 0x7fbb841401b0 2024-08-17T02:28:24.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.423+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb74013680 con 0x7fbb841401b0 2024-08-17T02:28:24.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.423+0000 7fbb7d600640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 0x7fbb68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.424+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbb74082370 con 0x7fbb841401b0 2024-08-17T02:28:24.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.424+0000 7fbb89e00640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 0x7fbb68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.425+0000 7fbb89e00640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 0x7fbb68067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001820 tx=0x7fbb78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.428+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb8413c8c0 con 0x7fbb841401b0 2024-08-17T02:28:24.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.675+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fbb84064db0 con 0x7fbb841401b0 2024-08-17T02:28:24.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.679+0000 7fbb7d600640 1 -- 172.21.15.46:0/1376232467 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbb740506e0 con 0x7fbb841401b0 2024-08-17T02:28:24.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 msgr2=0x7fbb68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 0x7fbb68067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb78001820 tx=0x7fbb78009040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 msgr2=0x7fbb8413b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400e900 tx=0x7fbb740090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 shutdown_connections 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fbb68065150 0x7fbb68067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb84140580 0x7fbb8415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbb841401b0 0x7fbb8413b0d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 --2- 172.21.15.46:0/1376232467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb840b1440 0x7fbb84158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 >> 172.21.15.46:0/1376232467 conn(0x7fbb840cb9b0 msgr2=0x7fbb8406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 shutdown_connections 2024-08-17T02:28:24.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.681+0000 7fbb8c800640 1 -- 172.21.15.46:0/1376232467 wait complete. 2024-08-17T02:28:24.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.873+0000 7fc4f3c00640 1 Processor -- start 2024-08-17T02:28:24.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.873+0000 7fc4f3c00640 1 -- start start 2024-08-17T02:28:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f3c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4ec158f80 0x7fc4ec0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f3c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 0x7fc4ec0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f3c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0cb560 con 0x7fc4ec159350 2024-08-17T02:28:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f3c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec0cf7e0 con 0x7fc4ec158f80 2024-08-17T02:28:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f3c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0cfac0 con 0x7fc4ec0cf280 2024-08-17T02:28:24.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4ec158f80 0x7fc4ec0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4e3e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc4ec159350 0x7fc4ec0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:45118/0 (socket says 172.21.15.46:45118) 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f1c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 0x7fc4ec0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4f1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4ec158f80 0x7fc4ec0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:36244/0 (socket says 172.21.15.46:36244) 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.875+0000 7fc4e3e00640 1 -- 172.21.15.46:0/1495715397 learned_addr learned my addr 172.21.15.46:0/1495715397 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4f1200640 1 -- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 msgr2=0x7fc4ec0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4f1200640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 0x7fc4ec0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4f1200640 1 -- 172.21.15.46:0/1495715397 >> v1:172.21.15.162:6789/0 conn(0x7fc4ec159350 legacy=0x7fc4ec0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4f1200640 1 -- 172.21.15.46:0/1495715397 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0caf10 con 0x7fc4ec158f80 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4f1c00640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 0x7fc4ec0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:24.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.876+0000 7fc4ebe00640 1 -- 172.21.15.46:0/1495715397 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541387716 0 0) 0x7fc4ec0cb560 con 0x7fc4ec159350 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.877+0000 7fc4f1200640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0ca330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009850 tx=0x7fc4dc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77f969d74f43a21a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.877+0000 7fc4ebe00640 1 -- 172.21.15.46:0/1495715397 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc02ad90 con 0x7fc4ec158f80 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.877+0000 7fc4ebe00640 1 -- 172.21.15.46:0/1495715397 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc032440 con 0x7fc4ec158f80 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.877+0000 7fc4ebe00640 1 -- 172.21.15.46:0/1495715397 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0327e0 con 0x7fc4ec158f80 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 -- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 msgr2=0x7fc4ec0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0ca330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009850 tx=0x7fc4dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 -- 172.21.15.46:0/1495715397 shutdown_connections 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec0cf280 0x7fc4ec0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/1495715397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0ca330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 -- 172.21.15.46:0/1495715397 >> 172.21.15.46:0/1495715397 conn(0x7fc4ec0cfd90 msgr2=0x7fc4ec0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 -- 172.21.15.46:0/1495715397 shutdown_connections 2024-08-17T02:28:24.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.878+0000 7fc4f3c00640 1 -- 172.21.15.46:0/1495715397 wait complete. 2024-08-17T02:28:24.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.879+0000 7fc4f3c00640 1 Processor -- start 2024-08-17T02:28:24.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.879+0000 7fc4f3c00640 1 -- start start 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec159350 0x7fc4ec0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec15c970 con 0x7fc4ec0cf280 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0c5300 con 0x7fc4ec158f80 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.880+0000 7fc4f3c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec15c3f0 con 0x7fc4ec159350 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39474/0 (socket says 172.21.15.46:39474) 2024-08-17T02:28:24.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 -- 172.21.15.46:0/2619137204 learned_addr learned my addr 172.21.15.46:0/2619137204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec159350 0x7fc4ec0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4e3e00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 -- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec159350 msgr2=0x7fc4ec0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec159350 0x7fc4ec0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 -- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 msgr2=0x7fc4ec0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.881+0000 7fc4f1200640 1 -- 172.21.15.46:0/2619137204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e4009a20 con 0x7fc4ec0cf280 2024-08-17T02:28:24.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4f1200640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009850 tx=0x7fc4dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc000d10 con 0x7fc4ec0cf280 2024-08-17T02:28:24.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc031e00 con 0x7fc4ec0cf280 2024-08-17T02:28:24.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc03d670 con 0x7fc4ec0cf280 2024-08-17T02:28:24.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc009390 con 0x7fc4ec0cf280 2024-08-17T02:28:24.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.882+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec0b5bc0 con 0x7fc4ec0cf280 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.883+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec064db0 con 0x7fc4ec0cf280 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.884+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc4dc039040 con 0x7fc4ec0cf280 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.885+0000 7fc4e8c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 0x7fc4c8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.885+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc4dc0a1ff0 con 0x7fc4ec0cf280 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.885+0000 7fc4e3e00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 0x7fc4c8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.886+0000 7fc4e3e00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 0x7fc4c8067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec069270 tx=0x7fc4d4007ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:24.889+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc4dc070410 con 0x7fc4ec0cf280 2024-08-17T02:28:25.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.072+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4ec068ce0 con 0x7fc4ec0cf280 2024-08-17T02:28:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.073+0000 7fc4e8c00640 1 -- 172.21.15.46:0/2619137204 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fc4dc073a30 con 0x7fc4ec0cf280 2024-08-17T02:28:25.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:25.074 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:21.611304+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 msgr2=0x7fc4c8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 0x7fc4c8067630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec069270 tx=0x7fc4d4007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 msgr2=0x7fc4ec0c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc009850 tx=0x7fc4dc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 shutdown_connections 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc4c8065180 0x7fc4c8067630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4ec159350 0x7fc4ec0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4ec158f80 0x7fc4ec0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 --2- 172.21.15.46:0/2619137204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc4ec0cf280 0x7fc4ec0c2ac0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 >> 172.21.15.46:0/2619137204 conn(0x7fc4ec0cfd90 msgr2=0x7fc4ec0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 shutdown_connections 2024-08-17T02:28:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.075+0000 7fc4f3c00640 1 -- 172.21.15.46:0/2619137204 wait complete. 2024-08-17T02:28:25.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:28:25.091 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.244+0000 7f8857400640 1 Processor -- start 2024-08-17T02:28:25.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.244+0000 7f8857400640 1 -- start start 2024-08-17T02:28:25.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f8857400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8850157e10 0x7f88500b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f8857400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 0x7f885015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f8857400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8850157070 con 0x7f88500b0a80 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f8857400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500b1390 con 0x7f8850157e10 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f8857400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885015b410 con 0x7f88500adec0 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f884fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8850157e10 0x7f88500b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f884fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8850157e10 0x7f88500b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39486/0 (socket says 172.21.15.46:39486) 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.245+0000 7f884fe00640 1 -- 172.21.15.46:0/1171241063 learned_addr learned my addr 172.21.15.46:0/1171241063 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f8855400640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 0x7f885015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f884fe00640 1 -- 172.21.15.46:0/1171241063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 msgr2=0x7f885015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f884fe00640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 0x7f885015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f884fe00640 1 -- 172.21.15.46:0/1171241063 >> v1:172.21.15.162:6789/0 conn(0x7f88500b0a80 legacy=0x7f88500ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f884fe00640 1 -- 172.21.15.46:0/1171241063 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850157330 con 0x7f8850157e10 2024-08-17T02:28:25.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.246+0000 7f8855400640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 0x7f885015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.247+0000 7f884fe00640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8850157e10 0x7f88500b0e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f883c009910 tx=0x7f883c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465643c0799c65e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.247+0000 7f884f400640 1 -- 172.21.15.46:0/1171241063 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c02ad30 con 0x7f8850157e10 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.247+0000 7f884f400640 1 -- 172.21.15.46:0/1171241063 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c02ae90 con 0x7f8850157e10 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.247+0000 7f884f400640 1 -- 172.21.15.46:0/1171241063 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c032670 con 0x7f8850157e10 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 -- 172.21.15.46:0/1171241063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8850157e10 msgr2=0x7f88500b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8850157e10 0x7f88500b0e50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f883c009910 tx=0x7f883c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 -- 172.21.15.46:0/1171241063 shutdown_connections 2024-08-17T02:28:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88500adec0 0x7f885015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 --2- 172.21.15.46:0/1171241063 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8850157e10 0x7f88500b0e50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 -- 172.21.15.46:0/1171241063 >> 172.21.15.46:0/1171241063 conn(0x7f8850067750 msgr2=0x7f88500cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 -- 172.21.15.46:0/1171241063 shutdown_connections 2024-08-17T02:28:25.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.248+0000 7f8857400640 1 -- 172.21.15.46:0/1171241063 wait complete. 2024-08-17T02:28:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.249+0000 7f8857400640 1 Processor -- start 2024-08-17T02:28:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.249+0000 7f8857400640 1 -- start start 2024-08-17T02:28:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88500adec0 0x7f885014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8850157e10 0x7f885014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501457a0 con 0x7f88500b0a80 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885014f680 con 0x7f88500adec0 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f8857400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885014ea70 con 0x7f8850157e10 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.250+0000 7f884fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39488/0 (socket says 172.21.15.46:39488) 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 -- 172.21.15.46:0/4242827070 learned_addr learned my addr 172.21.15.46:0/4242827070 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f8855400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8850157e10 0x7f885014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f8854a00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88500adec0 0x7f885014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 -- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8850157e10 msgr2=0x7f885014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8850157e10 0x7f885014e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 -- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88500adec0 msgr2=0x7f885014fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88500adec0 0x7f885014fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 -- 172.21.15.46:0/4242827070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009450 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.251+0000 7f884fe00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f883c009910 tx=0x7f883c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.252+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c032e20 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.252+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c031a60 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.252+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c031e20 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.252+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885014ed50 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.252+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885014f310 con 0x7f88500b0a80 2024-08-17T02:28:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.253+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885014f810 con 0x7f88500b0a80 2024-08-17T02:28:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.254+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f883c043030 con 0x7f88500b0a80 2024-08-17T02:28:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.254+0000 7f8843e00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 0x7f8830067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.254+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f883c041070 con 0x7f88500b0a80 2024-08-17T02:28:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.255+0000 7f8854a00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 0x7f8830067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.255+0000 7f8854a00640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 0x7f8830067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8844007fd0 tx=0x7f8844007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.258+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f883c070bb0 con 0x7f88500b0a80 2024-08-17T02:28:25.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.440+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8850064db0 con 0x7f88500b0a80 2024-08-17T02:28:25.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.441+0000 7f8843e00640 1 -- 172.21.15.46:0/4242827070 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f883c04b0a0 con 0x7f88500b0a80 2024-08-17T02:28:25.442 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 msgr2=0x7f8830067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 0x7f8830067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8844007fd0 tx=0x7f8844007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 msgr2=0x7f8850145260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f883c009910 tx=0x7f883c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 shutdown_connections 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8830065150 0x7f8830067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8850157e10 0x7f885014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f88500b0a80 0x7f8850145260 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 --2- 172.21.15.46:0/4242827070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88500adec0 0x7f885014fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 >> 172.21.15.46:0/4242827070 conn(0x7f8850067750 msgr2=0x7f88501598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 shutdown_connections 2024-08-17T02:28:25.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.443+0000 7f8857400640 1 -- 172.21.15.46:0/4242827070 wait complete. 2024-08-17T02:28:25.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:28:25.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.608+0000 7f8e37000640 1 Processor -- start 2024-08-17T02:28:25.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.608+0000 7f8e37000640 1 -- start start 2024-08-17T02:28:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.609+0000 7f8e37000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e300b5600 0x7f8e300c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.609+0000 7f8e37000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300c5f50 0x7f8e300c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.609+0000 7f8e37000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300c5580 con 0x7f8e300cdaf0 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.609+0000 7f8e37000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3006f1c0 con 0x7f8e300b5600 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.609+0000 7f8e37000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300c68c0 con 0x7f8e300c5f50 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8e300b5600 0x7f8e300c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e35000640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8e300cdaf0 0x7f8e300cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42748/0 (socket says 172.21.15.46:42748) 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e35000640 1 -- 172.21.15.46:0/2106660910 learned_addr learned my addr 172.21.15.46:0/2106660910 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:25.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2f400640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300c5f50 0x7f8e300c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2fe00640 1 -- 172.21.15.46:0/2106660910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300c5f50 msgr2=0x7f8e300c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300c5f50 0x7f8e300c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2fe00640 1 -- 172.21.15.46:0/2106660910 >> v1:172.21.15.46:6789/0 conn(0x7f8e300cdaf0 legacy=0x7f8e300cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.610+0000 7f8e2fe00640 1 -- 172.21.15.46:0/2106660910 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300c4c50 con 0x7f8e300b5600 2024-08-17T02:28:25.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.611+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300b5600 0x7f8e300c5a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009850 tx=0x7f8e200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9ddd1c6bc8e86a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.611+0000 7f8e2ea00640 1 -- 172.21.15.46:0/2106660910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2002ad90 con 0x7f8e300b5600 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e2ea00640 1 -- 172.21.15.46:0/2106660910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20032440 con 0x7f8e300b5600 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e2ea00640 1 -- 172.21.15.46:0/2106660910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20032820 con 0x7f8e300b5600 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 -- 172.21.15.46:0/2106660910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300b5600 msgr2=0x7f8e300c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300b5600 0x7f8e300c5a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009850 tx=0x7f8e200090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 -- 172.21.15.46:0/2106660910 shutdown_connections 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300c5f50 0x7f8e300c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 --2- 172.21.15.46:0/2106660910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300b5600 0x7f8e300c5a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 -- 172.21.15.46:0/2106660910 >> 172.21.15.46:0/2106660910 conn(0x7f8e3006eb90 msgr2=0x7f8e300cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 -- 172.21.15.46:0/2106660910 shutdown_connections 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.612+0000 7f8e37000640 1 -- 172.21.15.46:0/2106660910 wait complete. 2024-08-17T02:28:25.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.614+0000 7f8e37000640 1 Processor -- start 2024-08-17T02:28:25.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.614+0000 7f8e37000640 1 -- start start 2024-08-17T02:28:25.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300b5600 0x7f8e3015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e300c5f50 0x7f8e3009b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30159580 con 0x7f8e300cdaf0 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30099bb0 con 0x7f8e300c5f50 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e37000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3009cd50 con 0x7f8e300b5600 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e35000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300b5600 0x7f8e3015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e35000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39500/0 (socket says 172.21.15.46:39500) 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e35000640 1 -- 172.21.15.46:0/743857136 learned_addr learned my addr 172.21.15.46:0/743857136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.615+0000 7f8e2f400640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e300c5f50 0x7f8e3009b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 -- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300b5600 msgr2=0x7f8e3015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300b5600 0x7f8e3015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 -- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e300c5f50 msgr2=0x7f8e3009b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e300c5f50 0x7f8e3009b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 -- 172.21.15.46:0/743857136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009390 con 0x7f8e300cdaf0 2024-08-17T02:28:25.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e35000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800cbc0 tx=0x7f8e280019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800a640 con 0x7f8e300cdaf0 2024-08-17T02:28:25.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800a7a0 con 0x7f8e300cdaf0 2024-08-17T02:28:25.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800ab20 con 0x7f8e300cdaf0 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3009d010 con 0x7f8e300cdaf0 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.616+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3009d5d0 con 0x7f8e300cdaf0 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.617+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e300710c0 con 0x7f8e300cdaf0 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.618+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e28007300 con 0x7f8e300cdaf0 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.619+0000 7f8e27400640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.619+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8e28082330 con 0x7f8e300cdaf0 2024-08-17T02:28:25.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.619+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.620+0000 7f8e2fe00640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 0x7f8e10067630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e20034000 tx=0x7f8e20032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.623+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8e28050800 con 0x7f8e300cdaf0 2024-08-17T02:28:25.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.807+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8e3015d180 con 0x7f8e300cdaf0 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.807+0000 7f8e27400640 1 -- 172.21.15.46:0/743857136 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8e28053e20 con 0x7f8e300cdaf0 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:25.808 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-08-17T02:28:25.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 msgr2=0x7f8e10067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 0x7f8e10067630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e20034000 tx=0x7f8e20032000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 msgr2=0x7f8e3009b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800cbc0 tx=0x7f8e280019c0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 shutdown_connections 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e300cdaf0 0x7f8e3009b770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e300c5f50 0x7f8e3009b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8e10065180 0x7f8e10067630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 --2- 172.21.15.46:0/743857136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e300b5600 0x7f8e3015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 >> 172.21.15.46:0/743857136 conn(0x7f8e3006eb90 msgr2=0x7f8e300cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 shutdown_connections 2024-08-17T02:28:25.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.809+0000 7f8e37000640 1 -- 172.21.15.46:0/743857136 wait complete. 2024-08-17T02:28:25.826 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:28:25.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:28:25.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.981+0000 7fcce6000640 1 Processor -- start 2024-08-17T02:28:25.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.981+0000 7fcce6000640 1 -- start start 2024-08-17T02:28:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.982+0000 7fcce6000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.982+0000 7fcce6000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00ac390 con 0x7fcce0158f60 2024-08-17T02:28:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.982+0000 7fcce6000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce00ab4a0 con 0x7fcce00cc5f0 2024-08-17T02:28:25.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.982+0000 7fcce6000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce00ab780 con 0x7fcce0158b90 2024-08-17T02:28:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.982+0000 7fccdea00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcce0158f60 0x7fcce00ac820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42754/0 (socket says 172.21.15.46:42754) 2024-08-17T02:28:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccdea00640 1 -- 172.21.15.46:0/4128964458 learned_addr learned my addr 172.21.15.46:0/4128964458 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccdf400640 1 --2- 172.21.15.46:0/4128964458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215213702 0 0) 0x7fcce00ac390 con 0x7fcce0158f60 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc40034e0 con 0x7fcce0158f60 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560966869 0 0) 0x7fcce00ab4a0 con 0x7fcce00cc5f0 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce00ac390 con 0x7fcce00cc5f0 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccdf400640 1 -- 172.21.15.46:0/4128964458 >> v1:172.21.15.162:6789/0 conn(0x7fcce00cc5f0 legacy=0x7fcce006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccdf400640 1 -- 172.21.15.46:0/4128964458 >> v1:172.21.15.46:6789/0 conn(0x7fcce0158f60 legacy=0x7fcce00ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.983+0000 7fccdf400640 1 -- 172.21.15.46:0/4128964458 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce00aba60 con 0x7fcce0158b90 2024-08-17T02:28:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.984+0000 7fccdf400640 1 --2- 172.21.15.46:0/4128964458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce00aea40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d30789d7dbd3eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd002ae20 con 0x7fcce0158b90 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0032440 con 0x7fcce0158b90 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fccde000640 1 -- 172.21.15.46:0/4128964458 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00327e0 con 0x7fcce0158b90 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 -- 172.21.15.46:0/4128964458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 msgr2=0x7fcce00aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 --2- 172.21.15.46:0/4128964458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce00aea40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 -- 172.21.15.46:0/4128964458 shutdown_connections 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 --2- 172.21.15.46:0/4128964458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce00aea40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 -- 172.21.15.46:0/4128964458 >> 172.21.15.46:0/4128964458 conn(0x7fcce0067750 msgr2=0x7fcce00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 -- 172.21.15.46:0/4128964458 shutdown_connections 2024-08-17T02:28:25.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.985+0000 7fcce6000640 1 -- 172.21.15.46:0/4128964458 wait complete. 2024-08-17T02:28:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.987+0000 7fcce6000640 1 Processor -- start 2024-08-17T02:28:25.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.987+0000 7fcce6000640 1 -- start start 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce016d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 0x7fcce014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce0154e90 con 0x7fcce00cc5f0 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce016d700 con 0x7fcce0158f60 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fcce6000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce014a660 con 0x7fcce0158b90 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39506/0 (socket says 172.21.15.46:39506) 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 -- 172.21.15.46:0/858041505 learned_addr learned my addr 172.21.15.46:0/858041505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:25.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdfe00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 0x7fcce014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdea00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce016d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 -- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 msgr2=0x7fcce016d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce016d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 -- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 msgr2=0x7fcce014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 0x7fcce014a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdf400640 1 -- 172.21.15.46:0/858041505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009390 con 0x7fcce00cc5f0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.988+0000 7fccdfe00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 0x7fcce014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fccdf400640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0000c80 con 0x7fcce00cc5f0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0031a60 con 0x7fcce00cc5f0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0031e20 con 0x7fcce00cc5f0 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce0169860 con 0x7fcce00cc5f0 2024-08-17T02:28:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.989+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce0169e20 con 0x7fcce00cc5f0 2024-08-17T02:28:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.990+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce0064db0 con 0x7fcce00cc5f0 2024-08-17T02:28:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.991+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fccd0039040 con 0x7fcce00cc5f0 2024-08-17T02:28:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.992+0000 7fccd6a00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 0x7fccc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.992+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fccd00a1c70 con 0x7fcce00cc5f0 2024-08-17T02:28:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.992+0000 7fccdea00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 0x7fccc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.993+0000 7fccdea00640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 0x7fccc0067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcccc007fd0 tx=0x7fcccc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:25.996+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fccd006ffe0 con 0x7fcce00cc5f0 2024-08-17T02:28:26.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.177+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcce01537e0 con 0x7fcce00cc5f0 2024-08-17T02:28:26.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.688+0000 7fccd6a00640 1 -- 172.21.15.46:0/858041505 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fccd0073600 con 0x7fcce00cc5f0 2024-08-17T02:28:26.689 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-08-17T02:28:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.691+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 msgr2=0x7fccc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 0x7fccc0067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcccc007fd0 tx=0x7fcccc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 msgr2=0x7fcce01691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009880 tx=0x7fccd0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 shutdown_connections 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce0158f60 0x7fcce014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fccc0065150 0x7fccc0067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce0158b90 0x7fcce016d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 --2- 172.21.15.46:0/858041505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcce00cc5f0 0x7fcce01691d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 >> 172.21.15.46:0/858041505 conn(0x7fcce0067750 msgr2=0x7fcce01597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 shutdown_connections 2024-08-17T02:28:26.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.692+0000 7fcce6000640 1 -- 172.21.15.46:0/858041505 wait complete. 2024-08-17T02:28:26.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:28:26.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.870+0000 7f5aa4e00640 1 Processor -- start 2024-08-17T02:28:26.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.870+0000 7f5aa4e00640 1 -- start start 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5aa4e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0156d40 0x7f5aa006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5aa4e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5aa006e420 0x7f5aa00ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5aa4e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa01568b0 con 0x7f5aa0150130 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5aa4e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa006e8a0 con 0x7f5aa006e420 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5aa4e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0150500 con 0x7f5aa0156d40 2024-08-17T02:28:26.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5a9e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5aa006e420 0x7f5aa00ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.871+0000 7f5a9e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5aa006e420 0x7f5aa00ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39514/0 (socket says 172.21.15.46:39514) 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a9e800640 1 -- 172.21.15.46:0/777130676 learned_addr learned my addr 172.21.15.46:0/777130676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a97e00640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0156d40 0x7f5aa006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a9e800640 1 -- 172.21.15.46:0/777130676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0156d40 msgr2=0x7f5aa006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a9e800640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0156d40 0x7f5aa006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a9e800640 1 -- 172.21.15.46:0/777130676 >> v1:172.21.15.162:6789/0 conn(0x7f5aa0150130 legacy=0x7f5aa00aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.872+0000 7f5a9e800640 1 -- 172.21.15.46:0/777130676 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0155fc0 con 0x7f5aa006e420 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.873+0000 7f5a9e800640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa006e420 0x7f5aa00ab510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009f20 tx=0x7f5a98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7dd1194a6043c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.873+0000 7f5a9d400640 1 -- 172.21.15.46:0/777130676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98031400 con 0x7f5aa006e420 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.873+0000 7f5a9d400640 1 -- 172.21.15.46:0/777130676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9802d050 con 0x7f5aa006e420 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.873+0000 7f5a9d400640 1 -- 172.21.15.46:0/777130676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980317d0 con 0x7f5aa006e420 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 -- 172.21.15.46:0/777130676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa006e420 msgr2=0x7f5aa00ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa006e420 0x7f5aa00ab510 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009f20 tx=0x7f5a98009840 comp rx=0 tx=0).stop 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 -- 172.21.15.46:0/777130676 shutdown_connections 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa006e420 0x7f5aa00ab510 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/777130676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0156d40 0x7f5aa006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 -- 172.21.15.46:0/777130676 >> 172.21.15.46:0/777130676 conn(0x7f5aa0067750 msgr2=0x7f5aa006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 -- 172.21.15.46:0/777130676 shutdown_connections 2024-08-17T02:28:26.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.874+0000 7f5aa4e00640 1 -- 172.21.15.46:0/777130676 wait complete. 2024-08-17T02:28:26.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.875+0000 7f5aa4e00640 1 Processor -- start 2024-08-17T02:28:26.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 -- start start 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa006e420 0x7f5aa0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa0156d40 0x7f5aa00a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0158400 con 0x7f5aa0150130 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa015abf0 con 0x7f5aa0156d40 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.876+0000 7f5aa4e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01577f0 con 0x7f5aa006e420 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39520/0 (socket says 172.21.15.46:39520) 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 -- 172.21.15.46:0/1202178556 learned_addr learned my addr 172.21.15.46:0/1202178556 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a9de00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa006e420 0x7f5aa0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a9e800640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa0156d40 0x7f5aa00a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 -- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa006e420 msgr2=0x7f5aa0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa006e420 0x7f5aa0157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 -- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa0156d40 msgr2=0x7f5aa00a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa0156d40 0x7f5aa00a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 -- 172.21.15.46:0/1202178556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98009ae0 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.877+0000 7f5a97e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800d890 tx=0x7f5a88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.878+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880096a0 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.878+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a88009800 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.878+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a88009bc0 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.878+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa0157ad0 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.878+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa0158090 con 0x7f5aa0150130 2024-08-17T02:28:26.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.879+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa01585b0 con 0x7f5aa0150130 2024-08-17T02:28:26.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.880+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a88014620 con 0x7f5aa0150130 2024-08-17T02:28:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.881+0000 7f5a95600640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 0x7f5a7c067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.881+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f5a88082a90 con 0x7f5aa0150130 2024-08-17T02:28:26.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.882+0000 7f5a9de00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 0x7f5a7c067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.883+0000 7f5a9de00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 0x7f5a7c067700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a90007fd0 tx=0x7f5a90007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:26.886+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5aa01585b0 con 0x7f5aa0150130 2024-08-17T02:28:27.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.069+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5aa01585b0 con 0x7f5aa0150130 2024-08-17T02:28:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.696+0000 7f5a95600640 1 -- 172.21.15.46:0/1202178556 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5aa01585b0 con 0x7f5aa0150130 2024-08-17T02:28:27.698 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-08-17T02:28:27.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.702+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 msgr2=0x7f5a7c067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.702+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 0x7f5a7c067700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a90007fd0 tx=0x7f5a90007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:27.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.702+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 msgr2=0x7f5aa015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.702+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800d890 tx=0x7f5a88008040 comp rx=0 tx=0).stop 2024-08-17T02:28:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 shutdown_connections 2024-08-17T02:28:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa0156d40 0x7f5aa00a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5aa0150130 0x7f5aa015a6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a7c065250 0x7f5a7c067700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 --2- 172.21.15.46:0/1202178556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa006e420 0x7f5aa0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.704+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 >> 172.21.15.46:0/1202178556 conn(0x7f5aa0067750 msgr2=0x7f5aa006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.707+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 shutdown_connections 2024-08-17T02:28:27.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.707+0000 7f5aa4e00640 1 -- 172.21.15.46:0/1202178556 wait complete. 2024-08-17T02:28:27.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:28:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.892+0000 7faab7200640 1 Processor -- start 2024-08-17T02:28:27.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.892+0000 7faab7200640 1 -- start start 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.893+0000 7faab7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab80c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.893+0000 7faab7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faab80adfb0 0x7faab80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab7200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faab8155a30 0x7faab806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab7200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80afc40 con 0x7faab8155a30 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab7200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab80af030 con 0x7faab80adfb0 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab80af310 con 0x7faab8155660 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faab8155a30 0x7faab806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab80c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faab8155a30 0x7faab806dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39530/0 (socket says 172.21.15.46:39530) 2024-08-17T02:28:27.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 -- 172.21.15.46:0/1394579146 learned_addr learned my addr 172.21.15.46:0/1394579146 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faaafe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faab80adfb0 0x7faab80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab80c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:35628/0 (socket says 172.21.15.46:35628) 2024-08-17T02:28:27.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 -- 172.21.15.46:0/1394579146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 msgr2=0x7faab80c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 --2- 172.21.15.46:0/1394579146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab80c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 -- 172.21.15.46:0/1394579146 >> v2:172.21.15.162:3300/0 conn(0x7faab80adfb0 msgr2=0x7faab80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 --2- 172.21.15.46:0/1394579146 >> v2:172.21.15.162:3300/0 conn(0x7faab80adfb0 0x7faab80ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.894+0000 7faab6800640 1 -- 172.21.15.46:0/1394579146 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80af5f0 con 0x7faab8155a30 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.895+0000 7faab6800640 1 --2- 172.21.15.46:0/1394579146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab806dec0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faab80704c0 tx=0x7faab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ffebab8995b65 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab5400640 1 -- 172.21.15.46:0/1394579146 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0031400 con 0x7faab8155a30 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab5400640 1 -- 172.21.15.46:0/1394579146 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab002d050 con 0x7faab8155a30 2024-08-17T02:28:27.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab5400640 1 -- 172.21.15.46:0/1394579146 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00317d0 con 0x7faab8155a30 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 -- 172.21.15.46:0/1394579146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 msgr2=0x7faab806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 --2- 172.21.15.46:0/1394579146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab806dec0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faab80704c0 tx=0x7faab0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 -- 172.21.15.46:0/1394579146 shutdown_connections 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 --2- 172.21.15.46:0/1394579146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab806dec0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 --2- 172.21.15.46:0/1394579146 >> v2:172.21.15.162:3300/0 conn(0x7faab80adfb0 0x7faab80ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 --2- 172.21.15.46:0/1394579146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab80c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.896+0000 7faab7200640 1 -- 172.21.15.46:0/1394579146 >> 172.21.15.46:0/1394579146 conn(0x7faab8066cd0 msgr2=0x7faab80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.897+0000 7faab7200640 1 -- 172.21.15.46:0/1394579146 shutdown_connections 2024-08-17T02:28:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.897+0000 7faab7200640 1 -- 172.21.15.46:0/1394579146 wait complete. 2024-08-17T02:28:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.898+0000 7faab7200640 1 Processor -- start 2024-08-17T02:28:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.898+0000 7faab7200640 1 -- start start 2024-08-17T02:28:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab80adfb0 0x7faab814a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab81539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8154480 con 0x7faab8155a30 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8168d90 con 0x7faab80adfb0 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab8157520 con 0x7faab8155660 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab6800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39544/0 (socket says 172.21.15.46:39544) 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab6800640 1 -- 172.21.15.46:0/3239051474 learned_addr learned my addr 172.21.15.46:0/3239051474 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faaafe00640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab81539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.899+0000 7faab5e00640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab80adfb0 0x7faab814a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 -- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 msgr2=0x7faab81539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab81539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 -- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab80adfb0 msgr2=0x7faab814a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab80adfb0 0x7faab814a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 -- 172.21.15.46:0/3239051474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009ae0 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab6800640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faab002acd0 tx=0x7faab0034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00076e0 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0007840 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0007c00 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.900+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab8156bf0 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.901+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab81571b0 con 0x7faab8155a30 2024-08-17T02:28:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.902+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab8071050 con 0x7faab8155a30 2024-08-17T02:28:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.902+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faab0038070 con 0x7faab8155a30 2024-08-17T02:28:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.903+0000 7faaad600640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 0x7faa94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.903+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7faab00a3330 con 0x7faab8155a30 2024-08-17T02:28:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.904+0000 7faab5e00640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 0x7faa94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.904+0000 7faab5e00640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 0x7faa94067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009d20 tx=0x7faaa80090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:27.908+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faab0071460 con 0x7faab8155a30 2024-08-17T02:28:28.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.129+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faab8157660 con 0x7faab8155a30 2024-08-17T02:28:28.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.699+0000 7faaad600640 1 -- 172.21.15.46:0/3239051474 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7faab0074a80 con 0x7faab8155a30 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.712+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 msgr2=0x7faa94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.712+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 0x7faa94067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009d20 tx=0x7faaa80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.712+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 msgr2=0x7faab80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.712+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faab002acd0 tx=0x7faab0034000 comp rx=0 tx=0).stop 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 shutdown_connections 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faab8155a30 0x7faab80c06d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faa94065150 0x7faa94067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faab8155660 0x7faab81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 --2- 172.21.15.46:0/3239051474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab80adfb0 0x7faab814a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.713+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 >> 172.21.15.46:0/3239051474 conn(0x7faab8066cd0 msgr2=0x7faab80ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.719+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 shutdown_connections 2024-08-17T02:28:28.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.720+0000 7faab7200640 1 -- 172.21.15.46:0/3239051474 wait complete. 2024-08-17T02:28:28.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:28.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.904+0000 7fe353200640 1 Processor -- start 2024-08-17T02:28:28.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.904+0000 7fe353200640 1 -- start start 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe353200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe354159ca0 0x7fe3540ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe353200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540cadc0 con 0x7fe3540ca8a0 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe353200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540cb060 con 0x7fe3540ccca0 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe353200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540cd6e0 con 0x7fe354159ca0 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe34be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe3540ca8a0 0x7fe3540cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42768/0 (socket says 172.21.15.46:42768) 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe34be00640 1 -- 172.21.15.46:0/1914804641 learned_addr learned my addr 172.21.15.46:0/1914804641 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:28.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.905+0000 7fe351e00640 1 --2- 172.21.15.46:0/1914804641 >> v2:172.21.15.162:3300/0 conn(0x7fe354159ca0 0x7fe3540ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.906+0000 7fe351400640 1 -- 172.21.15.46:0/1914804641 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507804577 0 0) 0x7fe3540cadc0 con 0x7fe3540ca8a0 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.906+0000 7fe351400640 1 -- 172.21.15.46:0/1914804641 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3380034e0 con 0x7fe3540ca8a0 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.906+0000 7fe351e00640 1 -- 172.21.15.46:0/1914804641 >> v1:172.21.15.162:6789/0 conn(0x7fe3540ccca0 legacy=0x7fe354162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.906+0000 7fe351e00640 1 -- 172.21.15.46:0/1914804641 >> v1:172.21.15.46:6789/0 conn(0x7fe3540ca8a0 legacy=0x7fe3540cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.906+0000 7fe351e00640 1 -- 172.21.15.46:0/1914804641 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540cb300 con 0x7fe354159ca0 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.907+0000 7fe351e00640 1 --2- 172.21.15.46:0/1914804641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe354159ca0 0x7fe3540ca360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe344009850 tx=0x7fe3440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb7239a382bdf83 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.907+0000 7fe351400640 1 -- 172.21.15.46:0/1914804641 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34402ae20 con 0x7fe354159ca0 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.907+0000 7fe351400640 1 -- 172.21.15.46:0/1914804641 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344032440 con 0x7fe354159ca0 2024-08-17T02:28:28.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.907+0000 7fe351400640 1 -- 172.21.15.46:0/1914804641 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440327c0 con 0x7fe354159ca0 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 -- 172.21.15.46:0/1914804641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe354159ca0 msgr2=0x7fe3540ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 --2- 172.21.15.46:0/1914804641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe354159ca0 0x7fe3540ca360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe344009850 tx=0x7fe3440090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 -- 172.21.15.46:0/1914804641 shutdown_connections 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 --2- 172.21.15.46:0/1914804641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe354159ca0 0x7fe3540ca360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 -- 172.21.15.46:0/1914804641 >> 172.21.15.46:0/1914804641 conn(0x7fe354098e00 msgr2=0x7fe35406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 -- 172.21.15.46:0/1914804641 shutdown_connections 2024-08-17T02:28:28.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.908+0000 7fe353200640 1 -- 172.21.15.46:0/1914804641 wait complete. 2024-08-17T02:28:28.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.909+0000 7fe353200640 1 Processor -- start 2024-08-17T02:28:28.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.909+0000 7fe353200640 1 -- start start 2024-08-17T02:28:28.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3540ca8a0 0x7fe3540c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 0x7fe3540c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c9bd0 con 0x7fe3540ccca0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c5c00 con 0x7fe3540ca8a0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.910+0000 7fe353200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540c5920 con 0x7fe354159ca0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39558/0 (socket says 172.21.15.46:39558) 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 -- 172.21.15.46:0/2940485153 learned_addr learned my addr 172.21.15.46:0/2940485153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe351e00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3540ca8a0 0x7fe3540c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe352800640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 0x7fe3540c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 -- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 msgr2=0x7fe3540c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 0x7fe3540c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 -- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3540ca8a0 msgr2=0x7fe3540c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3540ca8a0 0x7fe3540c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 -- 172.21.15.46:0/2940485153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe344009390 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe352800640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 0x7fe3540c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.911+0000 7fe34be00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c590 tx=0x7fe33c007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.912+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c005aa0 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.912+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c005c40 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.912+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0070f0 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.912+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3540c7700 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.912+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3540c7170 con 0x7fe3540ccca0 2024-08-17T02:28:28.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.913+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3540c93b0 con 0x7fe3540ccca0 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.914+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe33c007520 con 0x7fe3540ccca0 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.914+0000 7fe349600640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 0x7fe330067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.915+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe33c081f40 con 0x7fe3540ccca0 2024-08-17T02:28:28.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.915+0000 7fe351e00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 0x7fe330067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.916+0000 7fe351e00640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 0x7fe330067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe344034000 tx=0x7fe344032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:28.919+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3540c93b0 con 0x7fe3540ccca0 2024-08-17T02:28:29.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.104+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3540c73f0 con 0x7fe3540ccca0 2024-08-17T02:28:29.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.105+0000 7fe349600640 1 -- 172.21.15.46:0/2940485153 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fe33c04ffe0 con 0x7fe3540ccca0 2024-08-17T02:28:29.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:29.106 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:28.130610+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:29.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.107+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 msgr2=0x7fe330067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.107+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 0x7fe330067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe344034000 tx=0x7fe344032000 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.107+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 msgr2=0x7fe354152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.107+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c590 tx=0x7fe33c007d40 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 shutdown_connections 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe330065150 0x7fe330067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe354159ca0 0x7fe3540c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe3540ccca0 0x7fe354152f30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 --2- 172.21.15.46:0/2940485153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3540ca8a0 0x7fe3540c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 >> 172.21.15.46:0/2940485153 conn(0x7fe354098e00 msgr2=0x7fe354155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 shutdown_connections 2024-08-17T02:28:29.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.108+0000 7fe353200640 1 -- 172.21.15.46:0/2940485153 wait complete. 2024-08-17T02:28:29.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.276+0000 7f174be00640 1 Processor -- start 2024-08-17T02:28:29.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.277+0000 7f174be00640 1 -- start start 2024-08-17T02:28:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.278+0000 7f174be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c155900 0x7f174c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.278+0000 7f174be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 0x7f174c156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.278+0000 7f174be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c157690 con 0x7f174c157b20 2024-08-17T02:28:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.278+0000 7f174be00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c156a80 con 0x7f174c155900 2024-08-17T02:28:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.278+0000 7f174be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c156d60 con 0x7f174c0b0270 2024-08-17T02:28:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c155900 0x7f174c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f174c155900 0x7f174c155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39570/0 (socket says 172.21.15.46:39570) 2024-08-17T02:28:29.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 -- 172.21.15.46:0/685600450 learned_addr learned my addr 172.21.15.46:0/685600450 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174a000640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 0x7f174c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 -- 172.21.15.46:0/685600450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 msgr2=0x7f174c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 0x7f174c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 -- 172.21.15.46:0/685600450 >> v1:172.21.15.46:6789/0 conn(0x7f174c157b20 legacy=0x7f174c157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174aa00640 1 -- 172.21.15.46:0/685600450 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c157040 con 0x7f174c155900 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f174a000640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 0x7f174c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:29.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.279+0000 7f1749600640 1 -- 172.21.15.46:0/685600450 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982964867 0 0) 0x7f174c157690 con 0x7f174c157b20 2024-08-17T02:28:29.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.280+0000 7f174aa00640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c155cd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f173c009910 tx=0x7f173c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa009f157598b849 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f1749600640 1 -- 172.21.15.46:0/685600450 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c02add0 con 0x7f174c155900 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f1749600640 1 -- 172.21.15.46:0/685600450 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c032440 con 0x7f174c155900 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f1749600640 1 -- 172.21.15.46:0/685600450 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c0327e0 con 0x7f174c155900 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 -- 172.21.15.46:0/685600450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 msgr2=0x7f174c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c155cd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f173c009910 tx=0x7f173c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 -- 172.21.15.46:0/685600450 shutdown_connections 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c0b0270 0x7f174c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 --2- 172.21.15.46:0/685600450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c155cd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 -- 172.21.15.46:0/685600450 >> 172.21.15.46:0/685600450 conn(0x7f174c067750 msgr2=0x7f174c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 -- 172.21.15.46:0/685600450 shutdown_connections 2024-08-17T02:28:29.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.281+0000 7f174be00640 1 -- 172.21.15.46:0/685600450 wait complete. 2024-08-17T02:28:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.283+0000 7f174be00640 1 Processor -- start 2024-08-17T02:28:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.283+0000 7f174be00640 1 -- start start 2024-08-17T02:28:29.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f174c0b0270 0x7f174c1420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c157b20 0x7f174c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c143af0 con 0x7f174c155900 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c142ee0 con 0x7f174c0b0270 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c1431c0 con 0x7f174c157b20 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39584/0 (socket says 172.21.15.46:39584) 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174a000640 1 -- 172.21.15.46:0/2450886924 learned_addr learned my addr 172.21.15.46:0/2450886924 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174aa00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f174c0b0270 0x7f174c1420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.284+0000 7f174b400640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c157b20 0x7f174c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 -- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c157b20 msgr2=0x7f174c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c157b20 0x7f174c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 -- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f174c0b0270 msgr2=0x7f174c1420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f174c0b0270 0x7f174c1420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 -- 172.21.15.46:0/2450886924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c009450 con 0x7f174c155900 2024-08-17T02:28:29.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174a000640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f173800d890 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800de80 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173800b8d0 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800bc90 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c1434a0 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.285+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c14a520 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.287+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c143c60 con 0x7f174c155900 2024-08-17T02:28:29.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.288+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f173801e460 con 0x7f174c155900 2024-08-17T02:28:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.289+0000 7f1742000640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 0x7f172c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.289+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1738082ae0 con 0x7f174c155900 2024-08-17T02:28:29.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.289+0000 7f174aa00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 0x7f172c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.290+0000 7f174aa00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 0x7f172c067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f173c034000 tx=0x7f173c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.296+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1738050b00 con 0x7f174c155900 2024-08-17T02:28:29.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.482+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174c071050 con 0x7f174c155900 2024-08-17T02:28:29.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.483+0000 7f1742000640 1 -- 172.21.15.46:0/2450886924 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f1738054120 con 0x7f174c155900 2024-08-17T02:28:29.484 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:29.484 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:28.130610+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 msgr2=0x7f172c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 0x7f172c067630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f173c034000 tx=0x7f173c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 msgr2=0x7f174c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f173800d890 tx=0x7f1738008040 comp rx=0 tx=0).stop 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 shutdown_connections 2024-08-17T02:28:29.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f172c065180 0x7f172c067630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f174c157b20 0x7f174c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f174c155900 0x7f174c0aacf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 --2- 172.21.15.46:0/2450886924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f174c0b0270 0x7f174c1420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 >> 172.21.15.46:0/2450886924 conn(0x7f174c067750 msgr2=0x7f174c0697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 shutdown_connections 2024-08-17T02:28:29.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.485+0000 7f174be00640 1 -- 172.21.15.46:0/2450886924 wait complete. 2024-08-17T02:28:29.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:28:29.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.665+0000 7f7375400640 1 Processor -- start 2024-08-17T02:28:29.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.665+0000 7f7375400640 1 -- start start 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f7375400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f73700c8bd0 0x7f73700c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f7375400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700ab130 con 0x7f73700adcf0 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f7375400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700c9530 con 0x7f7370156c50 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f7375400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700ae5a0 con 0x7f73700c8bd0 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f73700c8bd0 0x7f73700c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f73700c8bd0 0x7f73700c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39600/0 (socket says 172.21.15.46:39600) 2024-08-17T02:28:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 -- 172.21.15.46:0/1670764541 learned_addr learned my addr 172.21.15.46:0/1670764541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 -- 172.21.15.46:0/1670764541 >> v1:172.21.15.162:6789/0 conn(0x7f7370156c50 legacy=0x7f73700c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 -- 172.21.15.46:0/1670764541 >> v1:172.21.15.46:6789/0 conn(0x7f73700adcf0 legacy=0x7f73700ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.667+0000 7f736f200640 1 -- 172.21.15.46:0/1670764541 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700ae2c0 con 0x7f73700c8bd0 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.668+0000 7f736f200640 1 --2- 172.21.15.46:0/1670764541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700c8bd0 0x7f73700c8ff0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7368009f20 tx=0x7f7368009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114ff36deaadfb35 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f736de00640 1 -- 172.21.15.46:0/1670764541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368031400 con 0x7f73700c8bd0 2024-08-17T02:28:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f736de00640 1 -- 172.21.15.46:0/1670764541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736802d050 con 0x7f73700c8bd0 2024-08-17T02:28:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f736de00640 1 -- 172.21.15.46:0/1670764541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73680317d0 con 0x7f73700c8bd0 2024-08-17T02:28:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 -- 172.21.15.46:0/1670764541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700c8bd0 msgr2=0x7f73700c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 --2- 172.21.15.46:0/1670764541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700c8bd0 0x7f73700c8ff0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7368009f20 tx=0x7f7368009840 comp rx=0 tx=0).stop 2024-08-17T02:28:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 -- 172.21.15.46:0/1670764541 shutdown_connections 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 --2- 172.21.15.46:0/1670764541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700c8bd0 0x7f73700c8ff0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 -- 172.21.15.46:0/1670764541 >> 172.21.15.46:0/1670764541 conn(0x7f7370067750 msgr2=0x7f73700c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 -- 172.21.15.46:0/1670764541 shutdown_connections 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.669+0000 7f7375400640 1 -- 172.21.15.46:0/1670764541 wait complete. 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.671+0000 7f7375400640 1 Processor -- start 2024-08-17T02:28:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.671+0000 7f7375400640 1 -- start start 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 0x7f7370157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7370156c50 0x7f7370157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370169730 con 0x7f73700adcf0 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370169430 con 0x7f73700c8bd0 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7375400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737006d910 con 0x7f7370156c50 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39610/0 (socket says 172.21.15.46:39610) 2024-08-17T02:28:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 -- 172.21.15.46:0/3727746625 learned_addr learned my addr 172.21.15.46:0/3727746625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736f200640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7370156c50 0x7f7370157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7367e00640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 0x7f7370157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 -- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7370156c50 msgr2=0x7f7370157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7370156c50 0x7f7370157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 -- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 msgr2=0x7f7370157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 0x7f7370157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f736e800640 1 -- 172.21.15.46:0/3727746625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368009ae0 con 0x7f73700adcf0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.672+0000 7f7367e00640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 0x7f7370157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f736e800640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f736000c4c0 tx=0x7f7360007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011590 con 0x7f73700adcf0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7360011710 con 0x7f73700adcf0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7360011ad0 con 0x7f73700adcf0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370157b90 con 0x7f73700adcf0 2024-08-17T02:28:29.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.673+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7370158150 con 0x7f73700adcf0 2024-08-17T02:28:29.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.674+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7370071050 con 0x7f73700adcf0 2024-08-17T02:28:29.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.675+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f736001b3b0 con 0x7f73700adcf0 2024-08-17T02:28:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.676+0000 7f7366000640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 0x7f734c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.676+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7360081860 con 0x7f73700adcf0 2024-08-17T02:28:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.676+0000 7f7367e00640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 0x7f734c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.677+0000 7f7367e00640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 0x7f734c067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73700ad9f0 tx=0x7f7358009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.680+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f736004f9d0 con 0x7f73700adcf0 2024-08-17T02:28:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:29.907+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f73700acad0 con 0x7f73700adcf0 2024-08-17T02:28:30.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.730+0000 7f7366000640 1 -- 172.21.15.46:0/3727746625 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7360017070 con 0x7f73700adcf0 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.732+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 msgr2=0x7f734c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.732+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 0x7f734c067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f73700ad9f0 tx=0x7f7358009040 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.732+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 msgr2=0x7f737014c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.732+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f736000c4c0 tx=0x7f7360007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 shutdown_connections 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f734c065150 0x7f734c067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7370156c50 0x7f7370157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73700c8bd0 0x7f7370157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 --2- 172.21.15.46:0/3727746625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73700adcf0 0x7f737014c960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 >> 172.21.15.46:0/3727746625 conn(0x7f7370067750 msgr2=0x7f73700cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 shutdown_connections 2024-08-17T02:28:30.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.733+0000 7f7375400640 1 -- 172.21.15.46:0/3727746625 wait complete. 2024-08-17T02:28:30.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:28:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.910+0000 7f895e600640 1 Processor -- start 2024-08-17T02:28:30.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.910+0000 7f895e600640 1 -- start start 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895e600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f89580adfb0 0x7f89580ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155a30 0x7f895806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895e600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580afc40 con 0x7f8958155660 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895e600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89580af030 con 0x7f89580adfb0 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580af310 con 0x7f8958155a30 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895d200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8958155660 0x7f89580c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38664/0 (socket says 172.21.15.46:38664) 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f8957e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f89580adfb0 0x7f89580ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895d200640 1 -- 172.21.15.46:0/1645853684 learned_addr learned my addr 172.21.15.46:0/1645853684 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f895dc00640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155a30 0x7f895806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f8957e00640 1 -- 172.21.15.46:0/1645853684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155a30 msgr2=0x7f895806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.912+0000 7f8957e00640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155a30 0x7f895806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.913+0000 7f8957e00640 1 -- 172.21.15.46:0/1645853684 >> v1:172.21.15.46:6789/0 conn(0x7f8958155660 legacy=0x7f89580c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.913+0000 7f8957e00640 1 -- 172.21.15.46:0/1645853684 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580af5f0 con 0x7f89580adfb0 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.913+0000 7f8957400640 1 -- 172.21.15.46:0/1645853684 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272100658 0 0) 0x7f89580afc40 con 0x7f8958155660 2024-08-17T02:28:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f8957e00640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89580adfb0 0x7f89580ae750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8944009850 tx=0x7f89440090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0af2b06b5a985cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f8957400640 1 -- 172.21.15.46:0/1645853684 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894402ad90 con 0x7f89580adfb0 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f8957400640 1 -- 172.21.15.46:0/1645853684 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8944032440 con 0x7f89580adfb0 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f8957400640 1 -- 172.21.15.46:0/1645853684 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89440327e0 con 0x7f89580adfb0 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 -- 172.21.15.46:0/1645853684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89580adfb0 msgr2=0x7f89580ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89580adfb0 0x7f89580ae750 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8944009850 tx=0x7f89440090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 -- 172.21.15.46:0/1645853684 shutdown_connections 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155a30 0x7f895806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 --2- 172.21.15.46:0/1645853684 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89580adfb0 0x7f89580ae750 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.914+0000 7f895e600640 1 -- 172.21.15.46:0/1645853684 >> 172.21.15.46:0/1645853684 conn(0x7f8958066cd0 msgr2=0x7f89580670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.915+0000 7f895e600640 1 -- 172.21.15.46:0/1645853684 shutdown_connections 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.915+0000 7f895e600640 1 -- 172.21.15.46:0/1645853684 wait complete. 2024-08-17T02:28:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.916+0000 7f895e600640 1 Processor -- start 2024-08-17T02:28:30.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.916+0000 7f895e600640 1 -- start start 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89580adfb0 0x7f8958150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155660 0x7f89581579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895814a520 con 0x7f8958155a30 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89581515c0 con 0x7f89580adfb0 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895e600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895814a710 con 0x7f8958155660 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895dc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895dc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39298/0 (socket says 172.21.15.46:39298) 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895dc00640 1 -- 172.21.15.46:0/4022331062 learned_addr learned my addr 172.21.15.46:0/4022331062 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f895d200640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89580adfb0 0x7f8958150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.917+0000 7f8957e00640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155660 0x7f89581579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 -- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155660 msgr2=0x7f89581579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155660 0x7f89581579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 -- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89580adfb0 msgr2=0x7f8958150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89580adfb0 0x7f8958150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 -- 172.21.15.46:0/4022331062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944009390 con 0x7f8958155a30 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895dc00640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8950007f20 tx=0x7f8950009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000ee30 con 0x7f8958155a30 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950014420 con 0x7f8958155a30 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500147e0 con 0x7f8958155a30 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895814a9f0 con 0x7f8958155a30 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.918+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8958151270 con 0x7f8958155a30 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.919+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8958071050 con 0x7f8958155a30 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.920+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8950014b50 con 0x7f8958155a30 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.921+0000 7f894be00640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 0x7f8938067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.921+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8950082c50 con 0x7f8958155a30 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.921+0000 7f895d200640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 0x7f8938067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.922+0000 7f895d200640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 0x7f8938067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f894c0011e0 tx=0x7f894c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:30.925+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8950050c70 con 0x7f8958155a30 2024-08-17T02:28:31.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.147+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f895806c5f0 con 0x7f8958155a30 2024-08-17T02:28:31.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.737+0000 7f894be00640 1 -- 172.21.15.46:0/4022331062 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8950054290 con 0x7f8958155a30 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.739+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 msgr2=0x7f8938067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.739+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 0x7f8938067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f894c0011e0 tx=0x7f894c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.739+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 msgr2=0x7f895814bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.739+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8950007f20 tx=0x7f8950009860 comp rx=0 tx=0).stop 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 shutdown_connections 2024-08-17T02:28:31.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8958155a30 0x7f895814bb90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8938065150 0x7f8938067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8958155660 0x7f89581579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 --2- 172.21.15.46:0/4022331062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89580adfb0 0x7f8958150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 >> 172.21.15.46:0/4022331062 conn(0x7f8958066cd0 msgr2=0x7f89580693c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 shutdown_connections 2024-08-17T02:28:31.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.740+0000 7f895e600640 1 -- 172.21.15.46:0/4022331062 wait complete. 2024-08-17T02:28:31.758 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:31.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.912+0000 7fd2fba00640 1 Processor -- start 2024-08-17T02:28:31.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.912+0000 7fd2fba00640 1 -- start start 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2fba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2f4155a20 0x7fd2f40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2fba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f406df00 0x7fd2f40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2fba00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f4156670 con 0x7fd2f4155df0 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2fba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f40b0350 con 0x7fd2f4155a20 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2fba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f406e5e0 con 0x7fd2f406df00 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2f9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2f4155a20 0x7fd2f40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2f9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f406df00 0x7fd2f40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2f9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2f4155a20 0x7fd2f40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:41246/0 (socket says 172.21.15.46:41246) 2024-08-17T02:28:31.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.914+0000 7fd2f9000640 1 -- 172.21.15.46:0/3452509240 learned_addr learned my addr 172.21.15.46:0/3452509240 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.915+0000 7fd2f9000640 1 -- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f406df00 msgr2=0x7fd2f40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.915+0000 7fd2f9000640 1 --2- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f406df00 0x7fd2f40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.915+0000 7fd2f9000640 1 -- 172.21.15.46:0/3452509240 >> v1:172.21.15.162:6789/0 conn(0x7fd2f4155df0 legacy=0x7fd2f406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.915+0000 7fd2f3400640 1 -- 172.21.15.46:0/3452509240 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640742783 0 0) 0x7fd2f4156670 con 0x7fd2f4155df0 2024-08-17T02:28:31.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.915+0000 7fd2f9000640 1 -- 172.21.15.46:0/3452509240 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f406e8c0 con 0x7fd2f4155a20 2024-08-17T02:28:31.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2f9000640 1 --2- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f4155a20 0x7fd2f40adf10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009910 tx=0x7fd2e80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3a7eaa63bd3cb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2f3400640 1 -- 172.21.15.46:0/3452509240 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8031510 con 0x7fd2f4155a20 2024-08-17T02:28:31.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2f3400640 1 -- 172.21.15.46:0/3452509240 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e802f050 con 0x7fd2f4155a20 2024-08-17T02:28:31.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2f3400640 1 -- 172.21.15.46:0/3452509240 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80318a0 con 0x7fd2f4155a20 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2fba00640 1 -- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f4155a20 msgr2=0x7fd2f40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.916+0000 7fd2fba00640 1 --2- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f4155a20 0x7fd2f40adf10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009910 tx=0x7fd2e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 -- 172.21.15.46:0/3452509240 shutdown_connections 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 --2- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f406df00 0x7fd2f40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 --2- 172.21.15.46:0/3452509240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f4155a20 0x7fd2f40adf10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 -- 172.21.15.46:0/3452509240 >> 172.21.15.46:0/3452509240 conn(0x7fd2f40cb9b0 msgr2=0x7fd2f40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 -- 172.21.15.46:0/3452509240 shutdown_connections 2024-08-17T02:28:31.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.917+0000 7fd2fba00640 1 -- 172.21.15.46:0/3452509240 wait complete. 2024-08-17T02:28:31.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.918+0000 7fd2fba00640 1 Processor -- start 2024-08-17T02:28:31.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.918+0000 7fd2fba00640 1 -- start start 2024-08-17T02:28:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f406df00 0x7fd2f40ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f4155df0 0x7fd2f40a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40a7f30 con 0x7fd2f4155a20 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f4165ed0 con 0x7fd2f406df00 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2fba00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f40a7690 con 0x7fd2f4155df0 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2f3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.919+0000 7fd2f3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39304/0 (socket says 172.21.15.46:39304) 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 -- 172.21.15.46:0/2491765340 learned_addr learned my addr 172.21.15.46:0/2491765340 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f9a00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f4155df0 0x7fd2f40a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f9000640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f406df00 0x7fd2f40ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 -- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f4155df0 msgr2=0x7fd2f40a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f4155df0 0x7fd2f40a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 -- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f406df00 msgr2=0x7fd2f40ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f406df00 0x7fd2f40ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 -- 172.21.15.46:0/2491765340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8009450 con 0x7fd2f4155a20 2024-08-17T02:28:31.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2f3e00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c540 tx=0x7fd2e0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.920+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011590 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.921+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f40a7970 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.921+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00116f0 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.921+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011ab0 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.921+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f40a7390 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.922+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f4166060 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.923+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2e001b3b0 con 0x7fd2f4155a20 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.923+0000 7fd2e7e00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 0x7fd2d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.924+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2e00818d0 con 0x7fd2f4155a20 2024-08-17T02:28:31.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.924+0000 7fd2f9000640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 0x7fd2d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.925+0000 7fd2f9000640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 0x7fd2d4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8036000 tx=0x7fd2e8037000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:31.927+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2e004fa40 con 0x7fd2f4155a20 2024-08-17T02:28:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.147+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2f4064db0 con 0x7fd2f4155a20 2024-08-17T02:28:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.148+0000 7fd2e7e00640 1 -- 172.21.15.46:0/2491765340 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fd2e0017090 con 0x7fd2f4155a20 2024-08-17T02:28:32.148 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:32.149 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.149+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 msgr2=0x7fd2d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.149+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 0x7fd2d4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8036000 tx=0x7fd2e8037000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.149+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 msgr2=0x7fd2f413e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.149+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000c540 tx=0x7fd2e0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 shutdown_connections 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd2d4065150 0x7fd2d4067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2f4155df0 0x7fd2f40a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2f4155a20 0x7fd2f413e100 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 --2- 172.21.15.46:0/2491765340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2f406df00 0x7fd2f40ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 >> 172.21.15.46:0/2491765340 conn(0x7fd2f40cb9b0 msgr2=0x7fd2f406a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 shutdown_connections 2024-08-17T02:28:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.150+0000 7fd2fba00640 1 -- 172.21.15.46:0/2491765340 wait complete. 2024-08-17T02:28:32.166 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.316+0000 7f6627200640 1 Processor -- start 2024-08-17T02:28:32.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.317+0000 7f6627200640 1 -- start start 2024-08-17T02:28:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6627200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6628158bd0 0x7f6628069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6627200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66280ac710 0x7f66280af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6627200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280aec20 con 0x7f6628069540 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6627200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280699c0 con 0x7f6628158bd0 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6627200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280acb10 con 0x7f66280ac710 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6625e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6628158bd0 0x7f6628069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6625e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6628158bd0 0x7f6628069000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39320/0 (socket says 172.21.15.46:39320) 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f661d400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6628069540 0x7f66280ac000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38674/0 (socket says 172.21.15.46:38674) 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.318+0000 7f6625e00640 1 -- 172.21.15.46:0/3662238129 learned_addr learned my addr 172.21.15.46:0/3662238129 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6626800640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66280ac710 0x7f66280af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6625e00640 1 -- 172.21.15.46:0/3662238129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66280ac710 msgr2=0x7f66280af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6625e00640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66280ac710 0x7f66280af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6625e00640 1 -- 172.21.15.46:0/3662238129 >> v1:172.21.15.46:6789/0 conn(0x7f6628069540 legacy=0x7f66280ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6625400640 1 -- 172.21.15.46:0/3662238129 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216704616 0 0) 0x7f66280aec20 con 0x7f6628069540 2024-08-17T02:28:32.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.319+0000 7f6625e00640 1 -- 172.21.15.46:0/3662238129 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280ae330 con 0x7f6628158bd0 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.320+0000 7f6625e00640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f6628069000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6618009940 tx=0x7f66180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb7b6f725bf0c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.320+0000 7f6625400640 1 -- 172.21.15.46:0/3662238129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661802adb0 con 0x7f6628158bd0 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.320+0000 7f6625400640 1 -- 172.21.15.46:0/3662238129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618032440 con 0x7f6628158bd0 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.320+0000 7f6625400640 1 -- 172.21.15.46:0/3662238129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180327e0 con 0x7f6628158bd0 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 -- 172.21.15.46:0/3662238129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 msgr2=0x7f6628069000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f6628069000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6618009940 tx=0x7f66180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 -- 172.21.15.46:0/3662238129 shutdown_connections 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66280ac710 0x7f66280af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 --2- 172.21.15.46:0/3662238129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f6628069000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 -- 172.21.15.46:0/3662238129 >> 172.21.15.46:0/3662238129 conn(0x7f6628096a70 msgr2=0x7f66280cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 -- 172.21.15.46:0/3662238129 shutdown_connections 2024-08-17T02:28:32.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.321+0000 7f6627200640 1 -- 172.21.15.46:0/3662238129 wait complete. 2024-08-17T02:28:32.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.322+0000 7f6627200640 1 Processor -- start 2024-08-17T02:28:32.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.322+0000 7f6627200640 1 -- start start 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6628069540 0x7f66280c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 0x7f66281536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280cb6b0 con 0x7f6628158bd0 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c8a40 con 0x7f66280ac710 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6627200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c8110 con 0x7f6628069540 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.323+0000 7f6626800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39326/0 (socket says 172.21.15.46:39326) 2024-08-17T02:28:32.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 -- 172.21.15.46:0/276474363 learned_addr learned my addr 172.21.15.46:0/276474363 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f661d400640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 0x7f66281536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 -- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6628069540 msgr2=0x7f66280c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6628069540 0x7f66280c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 -- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 msgr2=0x7f66281536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 0x7f66281536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 -- 172.21.15.46:0/276474363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009450 con 0x7f6628158bd0 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f661d400640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 0x7f66281536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6626800640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6620009fd0 tx=0x7f6620009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662000ee90 con 0x7f6628158bd0 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620014420 con 0x7f6628158bd0 2024-08-17T02:28:32.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200147e0 con 0x7f6628158bd0 2024-08-17T02:28:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.324+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66280c83f0 con 0x7f6628158bd0 2024-08-17T02:28:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.325+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628153c00 con 0x7f6628158bd0 2024-08-17T02:28:32.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.326+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6628071050 con 0x7f6628158bd0 2024-08-17T02:28:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.327+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6620014b50 con 0x7f6628158bd0 2024-08-17T02:28:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.327+0000 7f661e000640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 0x7f6604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.327+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6620082ce0 con 0x7f6628158bd0 2024-08-17T02:28:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.328+0000 7f6625e00640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 0x7f6604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.329+0000 7f6625e00640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 0x7f6604067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6618034000 tx=0x7f6618032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.332+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6620050d00 con 0x7f6628158bd0 2024-08-17T02:28:32.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.517+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f662806b2d0 con 0x7f6628158bd0 2024-08-17T02:28:32.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.518+0000 7f661e000640 1 -- 172.21.15.46:0/276474363 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f6620054320 con 0x7f6628158bd0 2024-08-17T02:28:32.519 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:32.519 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:29.696150+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 msgr2=0x7f6604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 0x7f6604067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6618034000 tx=0x7f6618032000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 msgr2=0x7f66280ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6620009fd0 tx=0x7f6620009900 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 shutdown_connections 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6628158bd0 0x7f66280ccbd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66280ac710 0x7f66281536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6604065150 0x7f6604067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 --2- 172.21.15.46:0/276474363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6628069540 0x7f66280c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.520+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 >> 172.21.15.46:0/276474363 conn(0x7f6628096a70 msgr2=0x7f66280abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.521+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 shutdown_connections 2024-08-17T02:28:32.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.521+0000 7f6627200640 1 -- 172.21.15.46:0/276474363 wait complete. 2024-08-17T02:28:32.537 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:28:32.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:32.610 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-08-17T02:28:32.609+0000 7f99ac400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:32.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.688+0000 7fe2e3600640 1 Processor -- start 2024-08-17T02:28:32.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.688+0000 7fe2e3600640 1 -- start start 2024-08-17T02:28:32.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.689+0000 7fe2e3600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 0x7fe2dc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.689+0000 7fe2e3600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2dc0b1440 0x7fe2dc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.689+0000 7fe2e3600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0caa80 con 0x7fe2dc140580 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.689+0000 7fe2e3600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cb450 con 0x7fe2dc0b1440 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.689+0000 7fe2e3600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c9e70 con 0x7fe2dc1401b0 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2dc0b1440 0x7fe2dc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe2dc0b1440 0x7fe2dc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39338/0 (socket says 172.21.15.46:39338) 2024-08-17T02:28:32.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 -- 172.21.15.46:0/874555139 learned_addr learned my addr 172.21.15.46:0/874555139 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e0c00640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 0x7fe2dc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 -- 172.21.15.46:0/874555139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 msgr2=0x7fe2dc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 0x7fe2dc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 -- 172.21.15.46:0/874555139 >> v1:172.21.15.162:6789/0 conn(0x7fe2dc140580 legacy=0x7fe2dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e1600640 1 -- 172.21.15.46:0/874555139 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0ca150 con 0x7fe2dc0b1440 2024-08-17T02:28:32.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.690+0000 7fe2e0c00640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 0x7fe2dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:32.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.691+0000 7fe2e1600640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc0b1440 0x7fe2dc0c9040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009f20 tx=0x7fe2d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36afb6f9b96d8da9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.691+0000 7fe2dbe00640 1 -- 172.21.15.46:0/874555139 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4031400 con 0x7fe2dc0b1440 2024-08-17T02:28:32.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.691+0000 7fe2dbe00640 1 -- 172.21.15.46:0/874555139 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d402d050 con 0x7fe2dc0b1440 2024-08-17T02:28:32.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.691+0000 7fe2dbe00640 1 -- 172.21.15.46:0/874555139 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40317d0 con 0x7fe2dc0b1440 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 -- 172.21.15.46:0/874555139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc0b1440 msgr2=0x7fe2dc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc0b1440 0x7fe2dc0c9040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009f20 tx=0x7fe2d4009840 comp rx=0 tx=0).stop 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 -- 172.21.15.46:0/874555139 shutdown_connections 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc0b1440 0x7fe2dc0c9040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 --2- 172.21.15.46:0/874555139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc1401b0 0x7fe2dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 -- 172.21.15.46:0/874555139 >> 172.21.15.46:0/874555139 conn(0x7fe2dc0cb9b0 msgr2=0x7fe2dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 -- 172.21.15.46:0/874555139 shutdown_connections 2024-08-17T02:28:32.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.692+0000 7fe2e3600640 1 -- 172.21.15.46:0/874555139 wait complete. 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.693+0000 7fe2e3600640 1 Processor -- start 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.694+0000 7fe2e3600640 1 -- start start 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.694+0000 7fe2e3600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc0b1440 0x7fe2dc12f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.694+0000 7fe2e3600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2dc1401b0 0x7fe2dc0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.694+0000 7fe2e3600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e3600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc12ce20 con 0x7fe2dc140580 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e3600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc12d050 con 0x7fe2dc1401b0 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e3600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc12d330 con 0x7fe2dc0b1440 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39352/0 (socket says 172.21.15.46:39352) 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 -- 172.21.15.46:0/3663197949 learned_addr learned my addr 172.21.15.46:0/3663197949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:32.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e0c00640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc0b1440 0x7fe2dc12f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2d3e00640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2dc1401b0 0x7fe2dc0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 -- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc0b1440 msgr2=0x7fe2dc12f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc0b1440 0x7fe2dc12f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 -- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2dc1401b0 msgr2=0x7fe2dc0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2dc1401b0 0x7fe2dc0c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.695+0000 7fe2e1600640 1 -- 172.21.15.46:0/3663197949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4009ae0 con 0x7fe2dc140580 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2e1600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009f20 tx=0x7fe2d4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4008e50 con 0x7fe2dc140580 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d403b410 con 0x7fe2dc140580 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d403b7d0 con 0x7fe2dc140580 2024-08-17T02:28:32.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc12d610 con 0x7fe2dc140580 2024-08-17T02:28:32.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.696+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc12dbd0 con 0x7fe2dc140580 2024-08-17T02:28:32.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.697+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc12ddf0 con 0x7fe2dc140580 2024-08-17T02:28:32.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.698+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2d4038050 con 0x7fe2dc140580 2024-08-17T02:28:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.699+0000 7fe2d8c00640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.699+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2d40a35c0 con 0x7fe2dc140580 2024-08-17T02:28:32.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.699+0000 7fe2e0c00640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.700+0000 7fe2e0c00640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 0x7fe2b8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00aca0 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.703+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2d4071690 con 0x7fe2dc140580 2024-08-17T02:28:32.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.886+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2dc064db0 con 0x7fe2b8065150 2024-08-17T02:28:32.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.894+0000 7fe2d8c00640 1 -- 172.21.15.46:0/3663197949 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253797 (secure 0 0 0) 0x7fe2dc064db0 con 0x7fe2b8065150 2024-08-17T02:28:32.898 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:28:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 msgr2=0x7fe2b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 0x7fe2b8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00aca0 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 msgr2=0x7fe2dc12c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009f20 tx=0x7fe2d4036000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 shutdown_connections 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2dc140580 0x7fe2dc12c8e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2dc1401b0 0x7fe2dc0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 --2- 172.21.15.46:0/3663197949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2dc0b1440 0x7fe2dc12f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 >> 172.21.15.46:0/3663197949 conn(0x7fe2dc0cb9b0 msgr2=0x7fe2dc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 shutdown_connections 2024-08-17T02:28:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:32.898+0000 7fe2e3600640 1 -- 172.21.15.46:0/3663197949 wait complete. 2024-08-17T02:28:32.914 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-08-17T02:28:31.024081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399136,"kb_used_data":3604,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575584,"statfs":{"total":773094113280,"available":770637398016,"internally_reserved":0,"allocated":3690496,"data_stored":2092637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.334475"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.697546+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:23.443579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.778314+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:13.167579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.690594+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:33.966035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.692757+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:50:06.058951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.700863+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:43.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699979+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:07:17.446997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.691075+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:26.363610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699836+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:01.630833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.690871+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:17.878216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.777890+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:23.443579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.692180+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:18.894159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.690456+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:13.167579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699974+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:38:55.889349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.695173+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:58.325300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.690457+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:15.859292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.691483+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:18.894159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.695674+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:23.443579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.700064+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:51.161541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699954+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:56.957976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699877+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:34:27.478733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.777830+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:58.325300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.697644+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:38.687954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.700790+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:19.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.691860+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:17.878216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.695125+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:19.233247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.777254+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:19.233247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.694483+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:43.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.777238+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:48:43.853920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.694391+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:19.432421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.699844+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:16:00.447976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.690454+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:24.449439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:28:27.687871+0000","last_change":"2024-08-17T02:28:27.687871+0000","last_active":"2024-08-17T02:28:27.687871+0000","last_peered":"2024-08-17T02:28:27.687871+0000","last_clean":"2024-08-17T02:28:27.687871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:27.687871+0000","last_undegraded":"2024-08-17T02:28:27.687871+0000","last_fullsized":"2024-08-17T02:28:27.687871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:28:26.681454+0000","last_change":"2024-08-17T02:28:26.697528+0000","last_active":"2024-08-17T02:28:26.681454+0000","last_peered":"2024-08-17T02:28:26.681454+0000","last_clean":"2024-08-17T02:28:26.681454+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:28:26.681454+0000","last_undegraded":"2024-08-17T02:28:26.681454+0000","last_fullsized":"2024-08-17T02:28:26.681454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:58.325300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-08-17T02:28:21.619065+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:28:21.619065+0000","last_peered":"2024-08-17T02:28:21.619065+0000","last_clean":"2024-08-17T02:28:21.619065+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:28:21.619065+0000","last_undegraded":"2024-08-17T02:28:21.619065+0000","last_fullsized":"2024-08-17T02:28:21.619065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298244,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073596,"statfs":{"total":96636764160,"available":96331362304,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":323584,"data_stored":119067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297672,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074168,"statfs":{"total":96636764160,"available":96331948032,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297664,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074176,"statfs":{"total":96636764160,"available":96331956224,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301828,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070012,"statfs":{"total":96636764160,"available":96327692288,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301824,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070016,"statfs":{"total":96636764160,"available":96327696384,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301824,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070016,"statfs":{"total":96636764160,"available":96327696384,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302408,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069432,"statfs":{"total":96636764160,"available":96327098368,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:32.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.106+0000 7fc28d200640 1 Processor -- start 2024-08-17T02:28:33.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.106+0000 7fc28d200640 1 -- start start 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.107+0000 7fc28d200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc288158d60 0x7fc2880b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.107+0000 7fc28d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 0x7fc2880b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.107+0000 7fc28d200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2880b18d0 con 0x7fc28815cb30 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.107+0000 7fc28d200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b0d00 con 0x7fc288158d60 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.107+0000 7fc28d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880b0fa0 con 0x7fc2880c7420 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc288158d60 0x7fc2880b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc288158d60 0x7fc2880b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39364/0 (socket says 172.21.15.46:39364) 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 -- 172.21.15.46:0/3034916261 learned_addr learned my addr 172.21.15.46:0/3034916261 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285400640 1 --1- 172.21.15.46:0/3034916261 >> v1:172.21.15.46:6789/0 conn(0x7fc28815cb30 0x7fc2880c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38684/0 (socket says 172.21.15.46:38684) 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc286800640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 0x7fc2880b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 -- 172.21.15.46:0/3034916261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 msgr2=0x7fc2880b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 0x7fc2880b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 -- 172.21.15.46:0/3034916261 >> v1:172.21.15.46:6789/0 conn(0x7fc28815cb30 legacy=0x7fc2880c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc285e00640 1 -- 172.21.15.46:0/3034916261 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b1280 con 0x7fc288158d60 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc284a00640 1 -- 172.21.15.46:0/3034916261 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556475396 0 0) 0x7fc2880b18d0 con 0x7fc28815cb30 2024-08-17T02:28:33.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.108+0000 7fc286800640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 0x7fc2880b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.109+0000 7fc285e00640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc288158d60 0x7fc2880b1d60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc278009940 tx=0x7fc2780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db4a21e652dce9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.109+0000 7fc284a00640 1 -- 172.21.15.46:0/3034916261 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27802ae40 con 0x7fc288158d60 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.109+0000 7fc284a00640 1 -- 172.21.15.46:0/3034916261 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278032440 con 0x7fc288158d60 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.109+0000 7fc284a00640 1 -- 172.21.15.46:0/3034916261 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780327e0 con 0x7fc288158d60 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 -- 172.21.15.46:0/3034916261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc288158d60 msgr2=0x7fc2880b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc288158d60 0x7fc2880b1d60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc278009940 tx=0x7fc2780091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 -- 172.21.15.46:0/3034916261 shutdown_connections 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2880c7420 0x7fc2880b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 --2- 172.21.15.46:0/3034916261 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc288158d60 0x7fc2880b1d60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 -- 172.21.15.46:0/3034916261 >> 172.21.15.46:0/3034916261 conn(0x7fc2880b3040 msgr2=0x7fc2880b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 -- 172.21.15.46:0/3034916261 shutdown_connections 2024-08-17T02:28:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.110+0000 7fc28d200640 1 -- 172.21.15.46:0/3034916261 wait complete. 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.111+0000 7fc28d200640 1 Processor -- start 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.112+0000 7fc28d200640 1 -- start start 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.112+0000 7fc28d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.112+0000 7fc28d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 0x7fc28815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.112+0000 7fc28d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28815cb30 0x7fc28815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc28d200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288097a80 con 0x7fc2880c7420 2024-08-17T02:28:33.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc28d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880988a0 con 0x7fc28815cb30 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc28d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc288097c90 con 0x7fc288158d60 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39380/0 (socket says 172.21.15.46:39380) 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 -- 172.21.15.46:0/2488356674 learned_addr learned my addr 172.21.15.46:0/2488356674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285400640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 0x7fc28815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc286800640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28815cb30 0x7fc28815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 -- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 msgr2=0x7fc28815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 0x7fc28815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 -- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28815cb30 msgr2=0x7fc28815c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28815cb30 0x7fc28815c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 -- 172.21.15.46:0/2488356674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278009450 con 0x7fc2880c7420 2024-08-17T02:28:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285400640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 0x7fc28815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.113+0000 7fc285e00640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc2780099a0 tx=0x7fc278032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.114+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278031a60 con 0x7fc2880c7420 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.114+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278031be0 con 0x7fc2880c7420 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.114+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27803e450 con 0x7fc2880c7420 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.114+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc288097f70 con 0x7fc2880c7420 2024-08-17T02:28:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.114+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288098530 con 0x7fc2880c7420 2024-08-17T02:28:33.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.115+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc288064db0 con 0x7fc2880c7420 2024-08-17T02:28:33.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.116+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc27803c400 con 0x7fc2880c7420 2024-08-17T02:28:33.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.117+0000 7fc27d600640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 0x7fc268067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.117+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc27802ae40 con 0x7fc2880c7420 2024-08-17T02:28:33.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.118+0000 7fc285400640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 0x7fc268067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.118+0000 7fc285400640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 0x7fc268067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ceb80 tx=0x7fc274007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.121+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2780707f0 con 0x7fc2880c7420 2024-08-17T02:28:33.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.302+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2880ad570 con 0x7fc268065150 2024-08-17T02:28:33.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.310+0000 7fc27d600640 1 -- 172.21.15.46:0/2488356674 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264666 (secure 0 0 0) 0x7fc2880ad570 con 0x7fc268065150 2024-08-17T02:28:33.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:33.315 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 msgr2=0x7fc268067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 0x7fc268067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ceb80 tx=0x7fc274007dc0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 msgr2=0x7fc288152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc2780099a0 tx=0x7fc278032000 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 shutdown_connections 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28815cb30 0x7fc28815c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc268065150 0x7fc268067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc288158d60 0x7fc28815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 --2- 172.21.15.46:0/2488356674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2880c7420 0x7fc288152da0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 >> 172.21.15.46:0/2488356674 conn(0x7fc2880b3040 msgr2=0x7fc288096a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 shutdown_connections 2024-08-17T02:28:33.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.314+0000 7fc28d200640 1 -- 172.21.15.46:0/2488356674 wait complete. 2024-08-17T02:28:33.330 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:28:33.024585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399548,"kb_used_data":4028,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575172,"statfs":{"total":773094113280,"available":770636976128,"internally_reserved":0,"allocated":4124672,"data_stored":2286108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001554"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726487+0000","last_change":"2024-08-17T02:28:28.716080+0000","last_active":"2024-08-17T02:28:28.726487+0000","last_peered":"2024-08-17T02:28:28.726487+0000","last_clean":"2024-08-17T02:28:28.726487+0000","last_became_active":"2024-08-17T02:28:28.715788+0000","last_became_peered":"2024-08-17T02:28:28.715788+0000","last_unstale":"2024-08-17T02:28:28.726487+0000","last_undegraded":"2024-08-17T02:28:28.726487+0000","last_fullsized":"2024-08-17T02:28:28.726487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:45.431514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735412+0000","last_change":"2024-08-17T02:28:28.732332+0000","last_active":"2024-08-17T02:28:28.735412+0000","last_peered":"2024-08-17T02:28:28.735412+0000","last_clean":"2024-08-17T02:28:28.735412+0000","last_became_active":"2024-08-17T02:28:28.731978+0000","last_became_peered":"2024-08-17T02:28:28.731978+0000","last_unstale":"2024-08-17T02:28:28.735412+0000","last_undegraded":"2024-08-17T02:28:28.735412+0000","last_fullsized":"2024-08-17T02:28:28.735412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:41:00.309227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729472+0000","last_change":"2024-08-17T02:28:28.719139+0000","last_active":"2024-08-17T02:28:28.729472+0000","last_peered":"2024-08-17T02:28:28.729472+0000","last_clean":"2024-08-17T02:28:28.729472+0000","last_became_active":"2024-08-17T02:28:28.718882+0000","last_became_peered":"2024-08-17T02:28:28.718882+0000","last_unstale":"2024-08-17T02:28:28.729472+0000","last_undegraded":"2024-08-17T02:28:28.729472+0000","last_fullsized":"2024-08-17T02:28:28.729472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:13.735846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.737592+0000","last_change":"2024-08-17T02:28:28.730050+0000","last_active":"2024-08-17T02:28:28.737592+0000","last_peered":"2024-08-17T02:28:28.737592+0000","last_clean":"2024-08-17T02:28:28.737592+0000","last_became_active":"2024-08-17T02:28:28.723209+0000","last_became_peered":"2024-08-17T02:28:28.723209+0000","last_unstale":"2024-08-17T02:28:28.737592+0000","last_undegraded":"2024-08-17T02:28:28.737592+0000","last_fullsized":"2024-08-17T02:28:28.737592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:58.575531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.727606+0000","last_change":"2024-08-17T02:28:28.724375+0000","last_active":"2024-08-17T02:28:28.727606+0000","last_peered":"2024-08-17T02:28:28.727606+0000","last_clean":"2024-08-17T02:28:28.727606+0000","last_became_active":"2024-08-17T02:28:28.723856+0000","last_became_peered":"2024-08-17T02:28:28.723856+0000","last_unstale":"2024-08-17T02:28:28.727606+0000","last_undegraded":"2024-08-17T02:28:28.727606+0000","last_fullsized":"2024-08-17T02:28:28.727606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:59.331717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729956+0000","last_change":"2024-08-17T02:28:28.722183+0000","last_active":"2024-08-17T02:28:28.729956+0000","last_peered":"2024-08-17T02:28:28.729956+0000","last_clean":"2024-08-17T02:28:28.729956+0000","last_became_active":"2024-08-17T02:28:28.721882+0000","last_became_peered":"2024-08-17T02:28:28.721882+0000","last_unstale":"2024-08-17T02:28:28.729956+0000","last_undegraded":"2024-08-17T02:28:28.729956+0000","last_fullsized":"2024-08-17T02:28:28.729956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:48.302747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726997+0000","last_change":"2024-08-17T02:28:28.720645+0000","last_active":"2024-08-17T02:28:28.726997+0000","last_peered":"2024-08-17T02:28:28.726997+0000","last_clean":"2024-08-17T02:28:28.726997+0000","last_became_active":"2024-08-17T02:28:28.719978+0000","last_became_peered":"2024-08-17T02:28:28.719978+0000","last_unstale":"2024-08-17T02:28:28.726997+0000","last_undegraded":"2024-08-17T02:28:28.726997+0000","last_fullsized":"2024-08-17T02:28:28.726997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:22.246009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.723822+0000","last_change":"2024-08-17T02:28:28.717823+0000","last_active":"2024-08-17T02:28:28.723822+0000","last_peered":"2024-08-17T02:28:28.723822+0000","last_clean":"2024-08-17T02:28:28.723822+0000","last_became_active":"2024-08-17T02:28:28.716922+0000","last_became_peered":"2024-08-17T02:28:28.716922+0000","last_unstale":"2024-08-17T02:28:28.723822+0000","last_undegraded":"2024-08-17T02:28:28.723822+0000","last_fullsized":"2024-08-17T02:28:28.723822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:24.809010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.743086+0000","last_change":"2024-08-17T02:28:28.737701+0000","last_active":"2024-08-17T02:28:28.743086+0000","last_peered":"2024-08-17T02:28:28.743086+0000","last_clean":"2024-08-17T02:28:28.743086+0000","last_became_active":"2024-08-17T02:28:28.737416+0000","last_became_peered":"2024-08-17T02:28:28.737416+0000","last_unstale":"2024-08-17T02:28:28.743086+0000","last_undegraded":"2024-08-17T02:28:28.743086+0000","last_fullsized":"2024-08-17T02:28:28.743086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:31.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.741256+0000","last_change":"2024-08-17T02:28:28.726674+0000","last_active":"2024-08-17T02:28:28.741256+0000","last_peered":"2024-08-17T02:28:28.741256+0000","last_clean":"2024-08-17T02:28:28.741256+0000","last_became_active":"2024-08-17T02:28:28.726405+0000","last_became_peered":"2024-08-17T02:28:28.726405+0000","last_unstale":"2024-08-17T02:28:28.741256+0000","last_undegraded":"2024-08-17T02:28:28.741256+0000","last_fullsized":"2024-08-17T02:28:28.741256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:51.930016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.740465+0000","last_change":"2024-08-17T02:28:28.737065+0000","last_active":"2024-08-17T02:28:28.740465+0000","last_peered":"2024-08-17T02:28:28.740465+0000","last_clean":"2024-08-17T02:28:28.740465+0000","last_became_active":"2024-08-17T02:28:28.736842+0000","last_became_peered":"2024-08-17T02:28:28.736842+0000","last_unstale":"2024-08-17T02:28:28.740465+0000","last_undegraded":"2024-08-17T02:28:28.740465+0000","last_fullsized":"2024-08-17T02:28:28.740465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:35:42.092020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729791+0000","last_change":"2024-08-17T02:28:28.727441+0000","last_active":"2024-08-17T02:28:28.729791+0000","last_peered":"2024-08-17T02:28:28.729791+0000","last_clean":"2024-08-17T02:28:28.729791+0000","last_became_active":"2024-08-17T02:28:28.726566+0000","last_became_peered":"2024-08-17T02:28:28.726566+0000","last_unstale":"2024-08-17T02:28:28.729791+0000","last_undegraded":"2024-08-17T02:28:28.729791+0000","last_fullsized":"2024-08-17T02:28:28.729791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:31.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.722515+0000","last_change":"2024-08-17T02:28:28.716819+0000","last_active":"2024-08-17T02:28:28.722515+0000","last_peered":"2024-08-17T02:28:28.722515+0000","last_clean":"2024-08-17T02:28:28.722515+0000","last_became_active":"2024-08-17T02:28:28.716567+0000","last_became_peered":"2024-08-17T02:28:28.716567+0000","last_unstale":"2024-08-17T02:28:28.722515+0000","last_undegraded":"2024-08-17T02:28:28.722515+0000","last_fullsized":"2024-08-17T02:28:28.722515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:25.455856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.725403+0000","last_change":"2024-08-17T02:28:28.721677+0000","last_active":"2024-08-17T02:28:28.725403+0000","last_peered":"2024-08-17T02:28:28.725403+0000","last_clean":"2024-08-17T02:28:28.725403+0000","last_became_active":"2024-08-17T02:28:28.721323+0000","last_became_peered":"2024-08-17T02:28:28.721323+0000","last_unstale":"2024-08-17T02:28:28.725403+0000","last_undegraded":"2024-08-17T02:28:28.725403+0000","last_fullsized":"2024-08-17T02:28:28.725403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:55.750935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729739+0000","last_change":"2024-08-17T02:28:28.722036+0000","last_active":"2024-08-17T02:28:28.729739+0000","last_peered":"2024-08-17T02:28:28.729739+0000","last_clean":"2024-08-17T02:28:28.729739+0000","last_became_active":"2024-08-17T02:28:28.721763+0000","last_became_peered":"2024-08-17T02:28:28.721763+0000","last_unstale":"2024-08-17T02:28:28.729739+0000","last_undegraded":"2024-08-17T02:28:28.729739+0000","last_fullsized":"2024-08-17T02:28:28.729739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:53.038115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.734947+0000","last_change":"2024-08-17T02:28:28.730594+0000","last_active":"2024-08-17T02:28:28.734947+0000","last_peered":"2024-08-17T02:28:28.734947+0000","last_clean":"2024-08-17T02:28:28.734947+0000","last_became_active":"2024-08-17T02:28:28.730331+0000","last_became_peered":"2024-08-17T02:28:28.730331+0000","last_unstale":"2024-08-17T02:28:28.734947+0000","last_undegraded":"2024-08-17T02:28:28.734947+0000","last_fullsized":"2024-08-17T02:28:28.734947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:49.341074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726815+0000","last_change":"2024-08-17T02:28:28.720197+0000","last_active":"2024-08-17T02:28:28.726815+0000","last_peered":"2024-08-17T02:28:28.726815+0000","last_clean":"2024-08-17T02:28:28.726815+0000","last_became_active":"2024-08-17T02:28:28.719946+0000","last_became_peered":"2024-08-17T02:28:28.719946+0000","last_unstale":"2024-08-17T02:28:28.726815+0000","last_undegraded":"2024-08-17T02:28:28.726815+0000","last_fullsized":"2024-08-17T02:28:28.726815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:31.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.738722+0000","last_change":"2024-08-17T02:28:28.737866+0000","last_active":"2024-08-17T02:28:28.738722+0000","last_peered":"2024-08-17T02:28:28.738722+0000","last_clean":"2024-08-17T02:28:28.738722+0000","last_became_active":"2024-08-17T02:28:28.737467+0000","last_became_peered":"2024-08-17T02:28:28.737467+0000","last_unstale":"2024-08-17T02:28:28.738722+0000","last_undegraded":"2024-08-17T02:28:28.738722+0000","last_fullsized":"2024-08-17T02:28:28.738722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:31:25.358418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735849+0000","last_change":"2024-08-17T02:28:28.732904+0000","last_active":"2024-08-17T02:28:28.735849+0000","last_peered":"2024-08-17T02:28:28.735849+0000","last_clean":"2024-08-17T02:28:28.735849+0000","last_became_active":"2024-08-17T02:28:28.732593+0000","last_became_peered":"2024-08-17T02:28:28.732593+0000","last_unstale":"2024-08-17T02:28:28.735849+0000","last_undegraded":"2024-08-17T02:28:28.735849+0000","last_fullsized":"2024-08-17T02:28:28.735849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:58.077212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.720868+0000","last_change":"2024-08-17T02:28:28.714230+0000","last_active":"2024-08-17T02:28:28.720868+0000","last_peered":"2024-08-17T02:28:28.720868+0000","last_clean":"2024-08-17T02:28:28.720868+0000","last_became_active":"2024-08-17T02:28:28.711577+0000","last_became_peered":"2024-08-17T02:28:28.711577+0000","last_unstale":"2024-08-17T02:28:28.720868+0000","last_undegraded":"2024-08-17T02:28:28.720868+0000","last_fullsized":"2024-08-17T02:28:28.720868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:39.694371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.724267+0000","last_change":"2024-08-17T02:28:28.719550+0000","last_active":"2024-08-17T02:28:28.724267+0000","last_peered":"2024-08-17T02:28:28.724267+0000","last_clean":"2024-08-17T02:28:28.724267+0000","last_became_active":"2024-08-17T02:28:28.719237+0000","last_became_peered":"2024-08-17T02:28:28.719237+0000","last_unstale":"2024-08-17T02:28:28.724267+0000","last_undegraded":"2024-08-17T02:28:28.724267+0000","last_fullsized":"2024-08-17T02:28:28.724267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:53.038115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.731569+0000","last_change":"2024-08-17T02:28:28.727087+0000","last_active":"2024-08-17T02:28:28.731569+0000","last_peered":"2024-08-17T02:28:28.731569+0000","last_clean":"2024-08-17T02:28:28.731569+0000","last_became_active":"2024-08-17T02:28:28.726748+0000","last_became_peered":"2024-08-17T02:28:28.726748+0000","last_unstale":"2024-08-17T02:28:28.731569+0000","last_undegraded":"2024-08-17T02:28:28.731569+0000","last_fullsized":"2024-08-17T02:28:28.731569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:58.575531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.714395+0000","last_change":"2024-08-17T02:28:28.710059+0000","last_active":"2024-08-17T02:28:28.714395+0000","last_peered":"2024-08-17T02:28:28.714395+0000","last_clean":"2024-08-17T02:28:28.714395+0000","last_became_active":"2024-08-17T02:28:28.709780+0000","last_became_peered":"2024-08-17T02:28:28.709780+0000","last_unstale":"2024-08-17T02:28:28.714395+0000","last_undegraded":"2024-08-17T02:28:28.714395+0000","last_fullsized":"2024-08-17T02:28:28.714395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:17.488831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.721525+0000","last_change":"2024-08-17T02:28:28.714816+0000","last_active":"2024-08-17T02:28:28.721525+0000","last_peered":"2024-08-17T02:28:28.721525+0000","last_clean":"2024-08-17T02:28:28.721525+0000","last_became_active":"2024-08-17T02:28:28.714431+0000","last_became_peered":"2024-08-17T02:28:28.714431+0000","last_unstale":"2024-08-17T02:28:28.721525+0000","last_undegraded":"2024-08-17T02:28:28.721525+0000","last_fullsized":"2024-08-17T02:28:28.721525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:55.750935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.742045+0000","last_change":"2024-08-17T02:28:28.737100+0000","last_active":"2024-08-17T02:28:28.742045+0000","last_peered":"2024-08-17T02:28:28.742045+0000","last_clean":"2024-08-17T02:28:28.742045+0000","last_became_active":"2024-08-17T02:28:28.736815+0000","last_became_peered":"2024-08-17T02:28:28.736815+0000","last_unstale":"2024-08-17T02:28:28.742045+0000","last_undegraded":"2024-08-17T02:28:28.742045+0000","last_fullsized":"2024-08-17T02:28:28.742045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:52.240816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.725906+0000","last_change":"2024-08-17T02:28:28.721707+0000","last_active":"2024-08-17T02:28:28.725906+0000","last_peered":"2024-08-17T02:28:28.725906+0000","last_clean":"2024-08-17T02:28:28.725906+0000","last_became_active":"2024-08-17T02:28:28.721382+0000","last_became_peered":"2024-08-17T02:28:28.721382+0000","last_unstale":"2024-08-17T02:28:28.725906+0000","last_undegraded":"2024-08-17T02:28:28.725906+0000","last_fullsized":"2024-08-17T02:28:28.725906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:42:13.735846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735009+0000","last_change":"2024-08-17T02:28:28.731306+0000","last_active":"2024-08-17T02:28:28.735009+0000","last_peered":"2024-08-17T02:28:28.735009+0000","last_clean":"2024-08-17T02:28:28.735009+0000","last_became_active":"2024-08-17T02:28:28.731025+0000","last_became_peered":"2024-08-17T02:28:28.731025+0000","last_unstale":"2024-08-17T02:28:28.735009+0000","last_undegraded":"2024-08-17T02:28:28.735009+0000","last_fullsized":"2024-08-17T02:28:28.735009+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:31.270868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.713898+0000","last_change":"2024-08-17T02:28:28.709861+0000","last_active":"2024-08-17T02:28:28.713898+0000","last_peered":"2024-08-17T02:28:28.713898+0000","last_clean":"2024-08-17T02:28:28.713898+0000","last_became_active":"2024-08-17T02:28:28.709282+0000","last_became_peered":"2024-08-17T02:28:28.709282+0000","last_unstale":"2024-08-17T02:28:28.713898+0000","last_undegraded":"2024-08-17T02:28:28.713898+0000","last_fullsized":"2024-08-17T02:28:28.713898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:12:22.246009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.732078+0000","last_change":"2024-08-17T02:28:28.727088+0000","last_active":"2024-08-17T02:28:28.732078+0000","last_peered":"2024-08-17T02:28:28.732078+0000","last_clean":"2024-08-17T02:28:28.732078+0000","last_became_active":"2024-08-17T02:28:28.726681+0000","last_became_peered":"2024-08-17T02:28:28.726681+0000","last_unstale":"2024-08-17T02:28:28.732078+0000","last_undegraded":"2024-08-17T02:28:28.732078+0000","last_fullsized":"2024-08-17T02:28:28.732078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:21.057019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729560+0000","last_change":"2024-08-17T02:28:28.719887+0000","last_active":"2024-08-17T02:28:28.729560+0000","last_peered":"2024-08-17T02:28:28.729560+0000","last_clean":"2024-08-17T02:28:28.729560+0000","last_became_active":"2024-08-17T02:28:28.719608+0000","last_became_peered":"2024-08-17T02:28:28.719608+0000","last_unstale":"2024-08-17T02:28:28.729560+0000","last_undegraded":"2024-08-17T02:28:28.729560+0000","last_fullsized":"2024-08-17T02:28:28.729560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:53.038115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.721164+0000","last_change":"2024-08-17T02:28:28.714350+0000","last_active":"2024-08-17T02:28:28.721164+0000","last_peered":"2024-08-17T02:28:28.721164+0000","last_clean":"2024-08-17T02:28:28.721164+0000","last_became_active":"2024-08-17T02:28:28.714098+0000","last_became_peered":"2024-08-17T02:28:28.714098+0000","last_unstale":"2024-08-17T02:28:28.721164+0000","last_undegraded":"2024-08-17T02:28:28.721164+0000","last_fullsized":"2024-08-17T02:28:28.721164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:35.914737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.723837+0000","last_change":"2024-08-17T02:28:28.717952+0000","last_active":"2024-08-17T02:28:28.723837+0000","last_peered":"2024-08-17T02:28:28.723837+0000","last_clean":"2024-08-17T02:28:28.723837+0000","last_became_active":"2024-08-17T02:28:28.717250+0000","last_became_peered":"2024-08-17T02:28:28.717250+0000","last_unstale":"2024-08-17T02:28:28.723837+0000","last_undegraded":"2024-08-17T02:28:28.723837+0000","last_fullsized":"2024-08-17T02:28:28.723837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:00.994347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.717432+0000","last_change":"2024-08-17T02:28:28.710709+0000","last_active":"2024-08-17T02:28:28.717432+0000","last_peered":"2024-08-17T02:28:28.717432+0000","last_clean":"2024-08-17T02:28:28.717432+0000","last_became_active":"2024-08-17T02:28:28.710444+0000","last_became_peered":"2024-08-17T02:28:28.710444+0000","last_unstale":"2024-08-17T02:28:28.717432+0000","last_undegraded":"2024-08-17T02:28:28.717432+0000","last_fullsized":"2024-08-17T02:28:28.717432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:35:16.074706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735145+0000","last_change":"2024-08-17T02:28:27.721658+0000","last_active":"2024-08-17T02:28:28.735145+0000","last_peered":"2024-08-17T02:28:28.735145+0000","last_clean":"2024-08-17T02:28:28.735145+0000","last_became_active":"2024-08-17T02:28:27.721330+0000","last_became_peered":"2024-08-17T02:28:27.721330+0000","last_unstale":"2024-08-17T02:28:28.735145+0000","last_undegraded":"2024-08-17T02:28:28.735145+0000","last_fullsized":"2024-08-17T02:28:28.735145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:15.859292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.732390+0000","last_change":"2024-08-17T02:28:28.725400+0000","last_active":"2024-08-17T02:28:28.732390+0000","last_peered":"2024-08-17T02:28:28.732390+0000","last_clean":"2024-08-17T02:28:28.732390+0000","last_became_active":"2024-08-17T02:28:28.725064+0000","last_became_peered":"2024-08-17T02:28:28.725064+0000","last_unstale":"2024-08-17T02:28:28.732390+0000","last_undegraded":"2024-08-17T02:28:28.732390+0000","last_fullsized":"2024-08-17T02:28:28.732390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:11:43.192526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.727736+0000","last_change":"2024-08-17T02:28:27.714727+0000","last_active":"2024-08-17T02:28:28.727736+0000","last_peered":"2024-08-17T02:28:28.727736+0000","last_clean":"2024-08-17T02:28:28.727736+0000","last_became_active":"2024-08-17T02:28:27.714438+0000","last_became_peered":"2024-08-17T02:28:27.714438+0000","last_unstale":"2024-08-17T02:28:28.727736+0000","last_undegraded":"2024-08-17T02:28:28.727736+0000","last_fullsized":"2024-08-17T02:28:28.727736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:17.878216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.731978+0000","last_change":"2024-08-17T02:28:28.727075+0000","last_active":"2024-08-17T02:28:28.731978+0000","last_peered":"2024-08-17T02:28:28.731978+0000","last_clean":"2024-08-17T02:28:28.731978+0000","last_became_active":"2024-08-17T02:28:28.726794+0000","last_became_peered":"2024-08-17T02:28:28.726794+0000","last_unstale":"2024-08-17T02:28:28.731978+0000","last_undegraded":"2024-08-17T02:28:28.731978+0000","last_fullsized":"2024-08-17T02:28:28.731978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:24.809010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.737282+0000","last_change":"2024-08-17T02:28:27.719982+0000","last_active":"2024-08-17T02:28:28.737282+0000","last_peered":"2024-08-17T02:28:28.737282+0000","last_clean":"2024-08-17T02:28:28.737282+0000","last_became_active":"2024-08-17T02:28:27.719656+0000","last_became_peered":"2024-08-17T02:28:27.719656+0000","last_unstale":"2024-08-17T02:28:28.737282+0000","last_undegraded":"2024-08-17T02:28:28.737282+0000","last_fullsized":"2024-08-17T02:28:28.737282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:20.050602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.734567+0000","last_change":"2024-08-17T02:28:28.730249+0000","last_active":"2024-08-17T02:28:28.734567+0000","last_peered":"2024-08-17T02:28:28.734567+0000","last_clean":"2024-08-17T02:28:28.734567+0000","last_became_active":"2024-08-17T02:28:28.724268+0000","last_became_peered":"2024-08-17T02:28:28.724268+0000","last_unstale":"2024-08-17T02:28:28.734567+0000","last_undegraded":"2024-08-17T02:28:28.734567+0000","last_fullsized":"2024-08-17T02:28:28.734567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:01:53.038115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.739866+0000","last_change":"2024-08-17T02:28:27.716886+0000","last_active":"2024-08-17T02:28:28.739866+0000","last_peered":"2024-08-17T02:28:28.739866+0000","last_clean":"2024-08-17T02:28:28.739866+0000","last_became_active":"2024-08-17T02:28:27.716666+0000","last_became_peered":"2024-08-17T02:28:27.716666+0000","last_unstale":"2024-08-17T02:28:28.739866+0000","last_undegraded":"2024-08-17T02:28:28.739866+0000","last_fullsized":"2024-08-17T02:28:28.739866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:53:26.992274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.732677+0000","last_change":"2024-08-17T02:28:28.729098+0000","last_active":"2024-08-17T02:28:28.732677+0000","last_peered":"2024-08-17T02:28:28.732677+0000","last_clean":"2024-08-17T02:28:28.732677+0000","last_became_active":"2024-08-17T02:28:28.728797+0000","last_became_peered":"2024-08-17T02:28:28.728797+0000","last_unstale":"2024-08-17T02:28:28.732677+0000","last_undegraded":"2024-08-17T02:28:28.732677+0000","last_fullsized":"2024-08-17T02:28:28.732677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:55.750935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.734646+0000","last_change":"2024-08-17T02:28:27.711365+0000","last_active":"2024-08-17T02:28:28.734646+0000","last_peered":"2024-08-17T02:28:28.734646+0000","last_clean":"2024-08-17T02:28:28.734646+0000","last_became_active":"2024-08-17T02:28:27.710630+0000","last_became_peered":"2024-08-17T02:28:27.710630+0000","last_unstale":"2024-08-17T02:28:28.734646+0000","last_undegraded":"2024-08-17T02:28:28.734646+0000","last_fullsized":"2024-08-17T02:28:28.734646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:58:17.878216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.721295+0000","last_change":"2024-08-17T02:28:28.714053+0000","last_active":"2024-08-17T02:28:28.721295+0000","last_peered":"2024-08-17T02:28:28.721295+0000","last_clean":"2024-08-17T02:28:28.721295+0000","last_became_active":"2024-08-17T02:28:28.713753+0000","last_became_peered":"2024-08-17T02:28:28.713753+0000","last_unstale":"2024-08-17T02:28:28.721295+0000","last_undegraded":"2024-08-17T02:28:28.721295+0000","last_fullsized":"2024-08-17T02:28:28.721295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:49.341074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.734747+0000","last_change":"2024-08-17T02:28:27.717107+0000","last_active":"2024-08-17T02:28:28.734747+0000","last_peered":"2024-08-17T02:28:28.734747+0000","last_clean":"2024-08-17T02:28:28.734747+0000","last_became_active":"2024-08-17T02:28:27.716712+0000","last_became_peered":"2024-08-17T02:28:27.716712+0000","last_unstale":"2024-08-17T02:28:28.734747+0000","last_undegraded":"2024-08-17T02:28:28.734747+0000","last_fullsized":"2024-08-17T02:28:28.734747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:58.325300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.724054+0000","last_change":"2024-08-17T02:28:28.716399+0000","last_active":"2024-08-17T02:28:28.724054+0000","last_peered":"2024-08-17T02:28:28.724054+0000","last_clean":"2024-08-17T02:28:28.724054+0000","last_became_active":"2024-08-17T02:28:28.714627+0000","last_became_peered":"2024-08-17T02:28:28.714627+0000","last_unstale":"2024-08-17T02:28:28.724054+0000","last_undegraded":"2024-08-17T02:28:28.724054+0000","last_fullsized":"2024-08-17T02:28:28.724054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:52.240816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711164+0000","last_change":"2024-08-17T02:28:27.707010+0000","last_active":"2024-08-17T02:28:28.711164+0000","last_peered":"2024-08-17T02:28:28.711164+0000","last_clean":"2024-08-17T02:28:28.711164+0000","last_became_active":"2024-08-17T02:28:27.706707+0000","last_became_peered":"2024-08-17T02:28:27.706707+0000","last_unstale":"2024-08-17T02:28:28.711164+0000","last_undegraded":"2024-08-17T02:28:28.711164+0000","last_fullsized":"2024-08-17T02:28:28.711164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:34.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.731365+0000","last_change":"2024-08-17T02:28:28.720444+0000","last_active":"2024-08-17T02:28:28.731365+0000","last_peered":"2024-08-17T02:28:28.731365+0000","last_clean":"2024-08-17T02:28:28.731365+0000","last_became_active":"2024-08-17T02:28:28.717030+0000","last_became_peered":"2024-08-17T02:28:28.717030+0000","last_unstale":"2024-08-17T02:28:28.731365+0000","last_undegraded":"2024-08-17T02:28:28.731365+0000","last_fullsized":"2024-08-17T02:28:28.731365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:26.044968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711336+0000","last_change":"2024-08-17T02:28:27.713848+0000","last_active":"2024-08-17T02:28:28.711336+0000","last_peered":"2024-08-17T02:28:28.711336+0000","last_clean":"2024-08-17T02:28:28.711336+0000","last_became_active":"2024-08-17T02:28:27.713574+0000","last_became_peered":"2024-08-17T02:28:27.713574+0000","last_unstale":"2024-08-17T02:28:28.711336+0000","last_undegraded":"2024-08-17T02:28:28.711336+0000","last_fullsized":"2024-08-17T02:28:28.711336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:24.449439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.732897+0000","last_change":"2024-08-17T02:28:28.729192+0000","last_active":"2024-08-17T02:28:28.732897+0000","last_peered":"2024-08-17T02:28:28.732897+0000","last_clean":"2024-08-17T02:28:28.732897+0000","last_became_active":"2024-08-17T02:28:28.726631+0000","last_became_peered":"2024-08-17T02:28:28.726631+0000","last_unstale":"2024-08-17T02:28:28.732897+0000","last_undegraded":"2024-08-17T02:28:28.732897+0000","last_fullsized":"2024-08-17T02:28:28.732897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:58.575531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.719000+0000","last_change":"2024-08-17T02:28:27.715315+0000","last_active":"2024-08-17T02:28:28.719000+0000","last_peered":"2024-08-17T02:28:28.719000+0000","last_clean":"2024-08-17T02:28:28.719000+0000","last_became_active":"2024-08-17T02:28:27.715031+0000","last_became_peered":"2024-08-17T02:28:27.715031+0000","last_unstale":"2024-08-17T02:28:28.719000+0000","last_undegraded":"2024-08-17T02:28:28.719000+0000","last_fullsized":"2024-08-17T02:28:28.719000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:35:15.068289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.741994+0000","last_change":"2024-08-17T02:28:28.740965+0000","last_active":"2024-08-17T02:28:28.741994+0000","last_peered":"2024-08-17T02:28:28.741994+0000","last_clean":"2024-08-17T02:28:28.741994+0000","last_became_active":"2024-08-17T02:28:28.740350+0000","last_became_peered":"2024-08-17T02:28:28.740350+0000","last_unstale":"2024-08-17T02:28:28.741994+0000","last_undegraded":"2024-08-17T02:28:28.741994+0000","last_fullsized":"2024-08-17T02:28:28.741994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:07.506551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.703784+0000","last_change":"2024-08-17T02:28:27.711587+0000","last_active":"2024-08-17T02:28:28.703784+0000","last_peered":"2024-08-17T02:28:28.703784+0000","last_clean":"2024-08-17T02:28:28.703784+0000","last_became_active":"2024-08-17T02:28:27.711358+0000","last_became_peered":"2024-08-17T02:28:27.711358+0000","last_unstale":"2024-08-17T02:28:28.703784+0000","last_undegraded":"2024-08-17T02:28:28.703784+0000","last_fullsized":"2024-08-17T02:28:28.703784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:24.449439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.730739+0000","last_change":"2024-08-17T02:28:28.723093+0000","last_active":"2024-08-17T02:28:28.730739+0000","last_peered":"2024-08-17T02:28:28.730739+0000","last_clean":"2024-08-17T02:28:28.730739+0000","last_became_active":"2024-08-17T02:28:28.722873+0000","last_became_peered":"2024-08-17T02:28:28.722873+0000","last_unstale":"2024-08-17T02:28:28.730739+0000","last_undegraded":"2024-08-17T02:28:28.730739+0000","last_fullsized":"2024-08-17T02:28:28.730739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:36.180600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.730796+0000","last_change":"2024-08-17T02:28:27.709785+0000","last_active":"2024-08-17T02:28:28.730796+0000","last_peered":"2024-08-17T02:28:28.730796+0000","last_clean":"2024-08-17T02:28:28.730796+0000","last_became_active":"2024-08-17T02:28:27.709526+0000","last_became_peered":"2024-08-17T02:28:27.709526+0000","last_unstale":"2024-08-17T02:28:28.730796+0000","last_undegraded":"2024-08-17T02:28:28.730796+0000","last_fullsized":"2024-08-17T02:28:28.730796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:57:26.363610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.729495+0000","last_change":"2024-08-17T02:28:28.725312+0000","last_active":"2024-08-17T02:28:28.729495+0000","last_peered":"2024-08-17T02:28:28.729495+0000","last_clean":"2024-08-17T02:28:28.729495+0000","last_became_active":"2024-08-17T02:28:28.723500+0000","last_became_peered":"2024-08-17T02:28:28.723500+0000","last_unstale":"2024-08-17T02:28:28.729495+0000","last_undegraded":"2024-08-17T02:28:28.729495+0000","last_fullsized":"2024-08-17T02:28:28.729495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:30:36.180600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.744540+0000","last_change":"2024-08-17T02:28:27.721272+0000","last_active":"2024-08-17T02:28:28.744540+0000","last_peered":"2024-08-17T02:28:28.744540+0000","last_clean":"2024-08-17T02:28:28.744540+0000","last_became_active":"2024-08-17T02:28:27.720970+0000","last_became_peered":"2024-08-17T02:28:27.720970+0000","last_unstale":"2024-08-17T02:28:28.744540+0000","last_undegraded":"2024-08-17T02:28:28.744540+0000","last_fullsized":"2024-08-17T02:28:28.744540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:44.425097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.731919+0000","last_change":"2024-08-17T02:28:28.716718+0000","last_active":"2024-08-17T02:28:28.731919+0000","last_peered":"2024-08-17T02:28:28.731919+0000","last_clean":"2024-08-17T02:28:28.731919+0000","last_became_active":"2024-08-17T02:28:28.716297+0000","last_became_peered":"2024-08-17T02:28:28.716297+0000","last_unstale":"2024-08-17T02:28:28.731919+0000","last_undegraded":"2024-08-17T02:28:28.731919+0000","last_fullsized":"2024-08-17T02:28:28.731919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:25:24.809010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735817+0000","last_change":"2024-08-17T02:28:27.714352+0000","last_active":"2024-08-17T02:28:28.735817+0000","last_peered":"2024-08-17T02:28:28.735817+0000","last_clean":"2024-08-17T02:28:28.735817+0000","last_became_active":"2024-08-17T02:28:27.714096+0000","last_became_peered":"2024-08-17T02:28:27.714096+0000","last_unstale":"2024-08-17T02:28:28.735817+0000","last_undegraded":"2024-08-17T02:28:28.735817+0000","last_fullsized":"2024-08-17T02:28:28.735817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:15.859292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735913+0000","last_change":"2024-08-17T02:28:28.732908+0000","last_active":"2024-08-17T02:28:28.735913+0000","last_peered":"2024-08-17T02:28:28.735913+0000","last_clean":"2024-08-17T02:28:28.735913+0000","last_became_active":"2024-08-17T02:28:28.732412+0000","last_became_peered":"2024-08-17T02:28:28.732412+0000","last_unstale":"2024-08-17T02:28:28.735913+0000","last_undegraded":"2024-08-17T02:28:28.735913+0000","last_fullsized":"2024-08-17T02:28:28.735913+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:00.221970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.716556+0000","last_change":"2024-08-17T02:28:27.721710+0000","last_active":"2024-08-17T02:28:28.716556+0000","last_peered":"2024-08-17T02:28:28.716556+0000","last_clean":"2024-08-17T02:28:28.716556+0000","last_became_active":"2024-08-17T02:28:27.721483+0000","last_became_peered":"2024-08-17T02:28:27.721483+0000","last_unstale":"2024-08-17T02:28:28.716556+0000","last_undegraded":"2024-08-17T02:28:28.716556+0000","last_fullsized":"2024-08-17T02:28:28.716556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:33.966035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.725803+0000","last_change":"2024-08-17T02:28:28.718092+0000","last_active":"2024-08-17T02:28:28.725803+0000","last_peered":"2024-08-17T02:28:28.725803+0000","last_clean":"2024-08-17T02:28:28.725803+0000","last_became_active":"2024-08-17T02:28:28.717604+0000","last_became_peered":"2024-08-17T02:28:28.717604+0000","last_unstale":"2024-08-17T02:28:28.725803+0000","last_undegraded":"2024-08-17T02:28:28.725803+0000","last_fullsized":"2024-08-17T02:28:28.725803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:55:52.240816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711271+0000","last_change":"2024-08-17T02:28:27.711500+0000","last_active":"2024-08-17T02:28:28.711271+0000","last_peered":"2024-08-17T02:28:28.711271+0000","last_clean":"2024-08-17T02:28:28.711271+0000","last_became_active":"2024-08-17T02:28:27.711204+0000","last_became_peered":"2024-08-17T02:28:27.711204+0000","last_unstale":"2024-08-17T02:28:28.711271+0000","last_undegraded":"2024-08-17T02:28:28.711271+0000","last_fullsized":"2024-08-17T02:28:28.711271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:16.482414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735176+0000","last_change":"2024-08-17T02:28:28.730222+0000","last_active":"2024-08-17T02:28:28.735176+0000","last_peered":"2024-08-17T02:28:28.735176+0000","last_clean":"2024-08-17T02:28:28.735176+0000","last_became_active":"2024-08-17T02:28:28.729989+0000","last_became_peered":"2024-08-17T02:28:28.729989+0000","last_unstale":"2024-08-17T02:28:28.735176+0000","last_undegraded":"2024-08-17T02:28:28.735176+0000","last_fullsized":"2024-08-17T02:28:28.735176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:43:17.488831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.742955+0000","last_change":"2024-08-17T02:28:27.718489+0000","last_active":"2024-08-17T02:28:28.742955+0000","last_peered":"2024-08-17T02:28:28.742955+0000","last_clean":"2024-08-17T02:28:28.742955+0000","last_became_active":"2024-08-17T02:28:27.718107+0000","last_became_peered":"2024-08-17T02:28:27.718107+0000","last_unstale":"2024-08-17T02:28:28.742955+0000","last_undegraded":"2024-08-17T02:28:28.742955+0000","last_fullsized":"2024-08-17T02:28:28.742955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:11:42.186109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.725630+0000","last_change":"2024-08-17T02:28:28.722271+0000","last_active":"2024-08-17T02:28:28.725630+0000","last_peered":"2024-08-17T02:28:28.725630+0000","last_clean":"2024-08-17T02:28:28.725630+0000","last_became_active":"2024-08-17T02:28:28.722007+0000","last_became_peered":"2024-08-17T02:28:28.722007+0000","last_unstale":"2024-08-17T02:28:28.725630+0000","last_undegraded":"2024-08-17T02:28:28.725630+0000","last_fullsized":"2024-08-17T02:28:28.725630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:00.994347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.739561+0000","last_change":"2024-08-17T02:28:27.722613+0000","last_active":"2024-08-17T02:28:28.739561+0000","last_peered":"2024-08-17T02:28:28.739561+0000","last_clean":"2024-08-17T02:28:28.739561+0000","last_became_active":"2024-08-17T02:28:27.722266+0000","last_became_peered":"2024-08-17T02:28:27.722266+0000","last_unstale":"2024-08-17T02:28:28.739561+0000","last_undegraded":"2024-08-17T02:28:28.739561+0000","last_fullsized":"2024-08-17T02:28:28.739561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:24.449439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.730087+0000","last_change":"2024-08-17T02:28:28.721076+0000","last_active":"2024-08-17T02:28:28.730087+0000","last_peered":"2024-08-17T02:28:28.730087+0000","last_clean":"2024-08-17T02:28:28.730087+0000","last_became_active":"2024-08-17T02:28:28.720816+0000","last_became_peered":"2024-08-17T02:28:28.720816+0000","last_unstale":"2024-08-17T02:28:28.730087+0000","last_undegraded":"2024-08-17T02:28:28.730087+0000","last_fullsized":"2024-08-17T02:28:28.730087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:39.418475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.735882+0000","last_change":"2024-08-17T02:28:27.711946+0000","last_active":"2024-08-17T02:28:28.735882+0000","last_peered":"2024-08-17T02:28:28.735882+0000","last_clean":"2024-08-17T02:28:28.735882+0000","last_became_active":"2024-08-17T02:28:27.711627+0000","last_became_peered":"2024-08-17T02:28:27.711627+0000","last_unstale":"2024-08-17T02:28:28.735882+0000","last_undegraded":"2024-08-17T02:28:28.735882+0000","last_fullsized":"2024-08-17T02:28:28.735882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:33.966035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.737573+0000","last_change":"2024-08-17T02:28:28.723222+0000","last_active":"2024-08-17T02:28:28.737573+0000","last_peered":"2024-08-17T02:28:28.737573+0000","last_clean":"2024-08-17T02:28:28.737573+0000","last_became_active":"2024-08-17T02:28:28.722859+0000","last_became_peered":"2024-08-17T02:28:28.722859+0000","last_unstale":"2024-08-17T02:28:28.737573+0000","last_undegraded":"2024-08-17T02:28:28.737573+0000","last_fullsized":"2024-08-17T02:28:28.737573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:42:00.994347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.733022+0000","last_change":"2024-08-17T02:28:27.713921+0000","last_active":"2024-08-17T02:28:28.733022+0000","last_peered":"2024-08-17T02:28:28.733022+0000","last_clean":"2024-08-17T02:28:28.733022+0000","last_became_active":"2024-08-17T02:28:27.713631+0000","last_became_peered":"2024-08-17T02:28:27.713631+0000","last_unstale":"2024-08-17T02:28:28.733022+0000","last_undegraded":"2024-08-17T02:28:28.733022+0000","last_fullsized":"2024-08-17T02:28:28.733022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:38.687954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.720241+0000","last_change":"2024-08-17T02:28:28.712904+0000","last_active":"2024-08-17T02:28:28.720241+0000","last_peered":"2024-08-17T02:28:28.720241+0000","last_clean":"2024-08-17T02:28:28.720241+0000","last_became_active":"2024-08-17T02:28:28.712579+0000","last_became_peered":"2024-08-17T02:28:28.712579+0000","last_unstale":"2024-08-17T02:28:28.720241+0000","last_undegraded":"2024-08-17T02:28:28.720241+0000","last_fullsized":"2024-08-17T02:28:28.720241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:20.239664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711684+0000","last_change":"2024-08-17T02:28:27.716113+0000","last_active":"2024-08-17T02:28:28.711684+0000","last_peered":"2024-08-17T02:28:28.711684+0000","last_clean":"2024-08-17T02:28:28.711684+0000","last_became_active":"2024-08-17T02:28:27.715824+0000","last_became_peered":"2024-08-17T02:28:27.715824+0000","last_unstale":"2024-08-17T02:28:28.711684+0000","last_undegraded":"2024-08-17T02:28:28.711684+0000","last_fullsized":"2024-08-17T02:28:28.711684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:01:19.233247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726082+0000","last_change":"2024-08-17T02:28:28.721903+0000","last_active":"2024-08-17T02:28:28.726082+0000","last_peered":"2024-08-17T02:28:28.726082+0000","last_clean":"2024-08-17T02:28:28.726082+0000","last_became_active":"2024-08-17T02:28:28.721647+0000","last_became_peered":"2024-08-17T02:28:28.721647+0000","last_unstale":"2024-08-17T02:28:28.726082+0000","last_undegraded":"2024-08-17T02:28:28.726082+0000","last_fullsized":"2024-08-17T02:28:28.726082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:34.972452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.740373+0000","last_change":"2024-08-17T02:28:27.724077+0000","last_active":"2024-08-17T02:28:28.740373+0000","last_peered":"2024-08-17T02:28:28.740373+0000","last_clean":"2024-08-17T02:28:28.740373+0000","last_became_active":"2024-08-17T02:28:27.723642+0000","last_became_peered":"2024-08-17T02:28:27.723642+0000","last_unstale":"2024-08-17T02:28:28.740373+0000","last_undegraded":"2024-08-17T02:28:28.740373+0000","last_fullsized":"2024-08-17T02:28:28.740373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:33.966035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.713758+0000","last_change":"2024-08-17T02:28:28.711592+0000","last_active":"2024-08-17T02:28:28.713758+0000","last_peered":"2024-08-17T02:28:28.713758+0000","last_clean":"2024-08-17T02:28:28.713758+0000","last_became_active":"2024-08-17T02:28:28.711249+0000","last_became_peered":"2024-08-17T02:28:28.711249+0000","last_unstale":"2024-08-17T02:28:28.713758+0000","last_undegraded":"2024-08-17T02:28:28.713758+0000","last_fullsized":"2024-08-17T02:28:28.713758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:14.173996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.707987+0000","last_change":"2024-08-17T02:28:27.723748+0000","last_active":"2024-08-17T02:28:28.707987+0000","last_peered":"2024-08-17T02:28:28.707987+0000","last_clean":"2024-08-17T02:28:28.707987+0000","last_became_active":"2024-08-17T02:28:27.723461+0000","last_became_peered":"2024-08-17T02:28:27.723461+0000","last_unstale":"2024-08-17T02:28:28.707987+0000","last_undegraded":"2024-08-17T02:28:28.707987+0000","last_fullsized":"2024-08-17T02:28:28.707987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:13.167579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.714835+0000","last_change":"2024-08-17T02:28:28.711328+0000","last_active":"2024-08-17T02:28:28.714835+0000","last_peered":"2024-08-17T02:28:28.714835+0000","last_clean":"2024-08-17T02:28:28.714835+0000","last_became_active":"2024-08-17T02:28:28.711058+0000","last_became_peered":"2024-08-17T02:28:28.711058+0000","last_unstale":"2024-08-17T02:28:28.714835+0000","last_undegraded":"2024-08-17T02:28:28.714835+0000","last_fullsized":"2024-08-17T02:28:28.714835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:16.865709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711380+0000","last_change":"2024-08-17T02:28:27.723722+0000","last_active":"2024-08-17T02:28:28.711380+0000","last_peered":"2024-08-17T02:28:28.711380+0000","last_clean":"2024-08-17T02:28:28.711380+0000","last_became_active":"2024-08-17T02:28:27.723532+0000","last_became_peered":"2024-08-17T02:28:27.723532+0000","last_unstale":"2024-08-17T02:28:28.711380+0000","last_undegraded":"2024-08-17T02:28:28.711380+0000","last_fullsized":"2024-08-17T02:28:28.711380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:13.167579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726976+0000","last_change":"2024-08-17T02:28:28.720432+0000","last_active":"2024-08-17T02:28:28.726976+0000","last_peered":"2024-08-17T02:28:28.726976+0000","last_clean":"2024-08-17T02:28:28.726976+0000","last_became_active":"2024-08-17T02:28:28.719655+0000","last_became_peered":"2024-08-17T02:28:28.719655+0000","last_unstale":"2024-08-17T02:28:28.726976+0000","last_undegraded":"2024-08-17T02:28:28.726976+0000","last_fullsized":"2024-08-17T02:28:28.726976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:12:58.575531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.700984+0000","last_change":"2024-08-17T02:28:27.715873+0000","last_active":"2024-08-17T02:28:28.700984+0000","last_peered":"2024-08-17T02:28:28.700984+0000","last_clean":"2024-08-17T02:28:28.700984+0000","last_became_active":"2024-08-17T02:28:27.715181+0000","last_became_peered":"2024-08-17T02:28:27.715181+0000","last_unstale":"2024-08-17T02:28:28.700984+0000","last_undegraded":"2024-08-17T02:28:28.700984+0000","last_fullsized":"2024-08-17T02:28:28.700984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:07:34.908320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.714466+0000","last_change":"2024-08-17T02:28:28.712308+0000","last_active":"2024-08-17T02:28:28.714466+0000","last_peered":"2024-08-17T02:28:28.714466+0000","last_clean":"2024-08-17T02:28:28.714466+0000","last_became_active":"2024-08-17T02:28:28.712006+0000","last_became_peered":"2024-08-17T02:28:28.712006+0000","last_unstale":"2024-08-17T02:28:28.714466+0000","last_undegraded":"2024-08-17T02:28:28.714466+0000","last_fullsized":"2024-08-17T02:28:28.714466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:24.449996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.739482+0000","last_change":"2024-08-17T02:28:27.722774+0000","last_active":"2024-08-17T02:28:28.739482+0000","last_peered":"2024-08-17T02:28:28.739482+0000","last_clean":"2024-08-17T02:28:28.739482+0000","last_became_active":"2024-08-17T02:28:27.722492+0000","last_became_peered":"2024-08-17T02:28:27.722492+0000","last_unstale":"2024-08-17T02:28:28.739482+0000","last_undegraded":"2024-08-17T02:28:28.739482+0000","last_fullsized":"2024-08-17T02:28:28.739482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:15.859292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.734934+0000","last_change":"2024-08-17T02:28:28.729937+0000","last_active":"2024-08-17T02:28:28.734934+0000","last_peered":"2024-08-17T02:28:28.734934+0000","last_clean":"2024-08-17T02:28:28.734934+0000","last_became_active":"2024-08-17T02:28:28.723753+0000","last_became_peered":"2024-08-17T02:28:28.723753+0000","last_unstale":"2024-08-17T02:28:28.734934+0000","last_undegraded":"2024-08-17T02:28:28.734934+0000","last_fullsized":"2024-08-17T02:28:28.734934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:48.302747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:28:30.820216+0000","last_change":"2024-08-17T02:28:27.724387+0000","last_active":"2024-08-17T02:28:30.820216+0000","last_peered":"2024-08-17T02:28:30.820216+0000","last_clean":"2024-08-17T02:28:30.820216+0000","last_became_active":"2024-08-17T02:28:27.723778+0000","last_became_peered":"2024-08-17T02:28:27.723778+0000","last_unstale":"2024-08-17T02:28:30.820216+0000","last_undegraded":"2024-08-17T02:28:30.820216+0000","last_fullsized":"2024-08-17T02:28:30.820216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:15.859292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.727364+0000","last_change":"2024-08-17T02:28:28.725364+0000","last_active":"2024-08-17T02:28:28.727364+0000","last_peered":"2024-08-17T02:28:28.727364+0000","last_clean":"2024-08-17T02:28:28.727364+0000","last_became_active":"2024-08-17T02:28:28.725001+0000","last_became_peered":"2024-08-17T02:28:28.725001+0000","last_unstale":"2024-08-17T02:28:28.727364+0000","last_undegraded":"2024-08-17T02:28:28.727364+0000","last_fullsized":"2024-08-17T02:28:28.727364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:21.057019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.716410+0000","last_change":"2024-08-17T02:28:27.718395+0000","last_active":"2024-08-17T02:28:28.716410+0000","last_peered":"2024-08-17T02:28:28.716410+0000","last_clean":"2024-08-17T02:28:28.716410+0000","last_became_active":"2024-08-17T02:28:27.717445+0000","last_became_peered":"2024-08-17T02:28:27.717445+0000","last_unstale":"2024-08-17T02:28:28.716410+0000","last_undegraded":"2024-08-17T02:28:28.716410+0000","last_fullsized":"2024-08-17T02:28:28.716410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:42:13.167579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.721418+0000","last_change":"2024-08-17T02:28:28.713959+0000","last_active":"2024-08-17T02:28:28.721418+0000","last_peered":"2024-08-17T02:28:28.721418+0000","last_clean":"2024-08-17T02:28:28.721418+0000","last_became_active":"2024-08-17T02:28:28.713703+0000","last_became_peered":"2024-08-17T02:28:28.713703+0000","last_unstale":"2024-08-17T02:28:28.721418+0000","last_undegraded":"2024-08-17T02:28:28.721418+0000","last_fullsized":"2024-08-17T02:28:28.721418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:31:21.057019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.701380+0000","last_change":"2024-08-17T02:28:27.712403+0000","last_active":"2024-08-17T02:28:28.701380+0000","last_peered":"2024-08-17T02:28:28.701380+0000","last_clean":"2024-08-17T02:28:28.701380+0000","last_became_active":"2024-08-17T02:28:27.710719+0000","last_became_peered":"2024-08-17T02:28:27.710719+0000","last_unstale":"2024-08-17T02:28:28.701380+0000","last_undegraded":"2024-08-17T02:28:28.701380+0000","last_fullsized":"2024-08-17T02:28:28.701380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:38.687954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.726831+0000","last_change":"2024-08-17T02:28:28.720230+0000","last_active":"2024-08-17T02:28:28.726831+0000","last_peered":"2024-08-17T02:28:28.726831+0000","last_clean":"2024-08-17T02:28:28.726831+0000","last_became_active":"2024-08-17T02:28:28.719964+0000","last_became_peered":"2024-08-17T02:28:28.719964+0000","last_unstale":"2024-08-17T02:28:28.726831+0000","last_undegraded":"2024-08-17T02:28:28.726831+0000","last_fullsized":"2024-08-17T02:28:28.726831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:11:43.192526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.716624+0000","last_change":"2024-08-17T02:28:27.722884+0000","last_active":"2024-08-17T02:28:28.716624+0000","last_peered":"2024-08-17T02:28:28.716624+0000","last_clean":"2024-08-17T02:28:28.716624+0000","last_became_active":"2024-08-17T02:28:27.722558+0000","last_became_peered":"2024-08-17T02:28:27.722558+0000","last_unstale":"2024-08-17T02:28:28.716624+0000","last_undegraded":"2024-08-17T02:28:28.716624+0000","last_fullsized":"2024-08-17T02:28:28.716624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:19:38.687954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.730542+0000","last_change":"2024-08-17T02:28:28.724478+0000","last_active":"2024-08-17T02:28:28.730542+0000","last_peered":"2024-08-17T02:28:28.730542+0000","last_clean":"2024-08-17T02:28:28.730542+0000","last_became_active":"2024-08-17T02:28:28.724182+0000","last_became_peered":"2024-08-17T02:28:28.724182+0000","last_unstale":"2024-08-17T02:28:28.730542+0000","last_undegraded":"2024-08-17T02:28:28.730542+0000","last_fullsized":"2024-08-17T02:28:28.730542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:32:39.418475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711429+0000","last_change":"2024-08-17T02:28:27.716333+0000","last_active":"2024-08-17T02:28:28.711429+0000","last_peered":"2024-08-17T02:28:28.711429+0000","last_clean":"2024-08-17T02:28:28.711429+0000","last_became_active":"2024-08-17T02:28:27.715168+0000","last_became_peered":"2024-08-17T02:28:27.715168+0000","last_unstale":"2024-08-17T02:28:28.711429+0000","last_undegraded":"2024-08-17T02:28:28.711429+0000","last_fullsized":"2024-08-17T02:28:28.711429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:26:23.443579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.731081+0000","last_change":"2024-08-17T02:28:28.726842+0000","last_active":"2024-08-17T02:28:28.731081+0000","last_peered":"2024-08-17T02:28:28.731081+0000","last_clean":"2024-08-17T02:28:28.731081+0000","last_became_active":"2024-08-17T02:28:28.726568+0000","last_became_peered":"2024-08-17T02:28:28.726568+0000","last_unstale":"2024-08-17T02:28:28.731081+0000","last_undegraded":"2024-08-17T02:28:28.731081+0000","last_fullsized":"2024-08-17T02:28:28.731081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:26.044968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.711950+0000","last_change":"2024-08-17T02:28:27.710621+0000","last_active":"2024-08-17T02:28:28.711950+0000","last_peered":"2024-08-17T02:28:28.711950+0000","last_clean":"2024-08-17T02:28:28.711950+0000","last_became_active":"2024-08-17T02:28:27.710320+0000","last_became_peered":"2024-08-17T02:28:27.710320+0000","last_unstale":"2024-08-17T02:28:28.711950+0000","last_undegraded":"2024-08-17T02:28:28.711950+0000","last_fullsized":"2024-08-17T02:28:28.711950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:47:03.376846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.723903+0000","last_change":"2024-08-17T02:28:28.717177+0000","last_active":"2024-08-17T02:28:28.723903+0000","last_peered":"2024-08-17T02:28:28.723903+0000","last_clean":"2024-08-17T02:28:28.723903+0000","last_became_active":"2024-08-17T02:28:28.716933+0000","last_became_peered":"2024-08-17T02:28:28.716933+0000","last_unstale":"2024-08-17T02:28:28.723903+0000","last_undegraded":"2024-08-17T02:28:28.723903+0000","last_fullsized":"2024-08-17T02:28:28.723903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:27.687871+0000","last_clean_scrub_stamp":"2024-08-17T02:28:27.687871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:26.044968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.707272+0000","last_change":"2024-08-17T02:28:27.716866+0000","last_active":"2024-08-17T02:28:28.707272+0000","last_peered":"2024-08-17T02:28:28.707272+0000","last_clean":"2024-08-17T02:28:28.707272+0000","last_became_active":"2024-08-17T02:28:27.716609+0000","last_became_peered":"2024-08-17T02:28:27.716609+0000","last_unstale":"2024-08-17T02:28:28.707272+0000","last_undegraded":"2024-08-17T02:28:28.707272+0000","last_fullsized":"2024-08-17T02:28:28.707272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:26.681454+0000","last_clean_scrub_stamp":"2024-08-17T02:28:26.681454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:18:24.449439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:28.703877+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:28:28.703877+0000","last_peered":"2024-08-17T02:28:28.703877+0000","last_clean":"2024-08-17T02:28:28.703877+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:28:28.703877+0000","last_undegraded":"2024-08-17T02:28:28.703877+0000","last_fullsized":"2024-08-17T02:28:28.703877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":946176,"data_stored":722543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":138977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":368640,"data_stored":139033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301884,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069956,"statfs":{"total":96636764160,"available":96327634944,"internally_reserved":0,"allocated":376832,"data_stored":139947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:33.334 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:28:33.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:28:33.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.529+0000 7fa193200640 1 Processor -- start 2024-08-17T02:28:33.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.529+0000 7fa193200640 1 -- start start 2024-08-17T02:28:33.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c06a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa18c06a900 0x7fa18c0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18c0a9fe0 0x7fa18c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c15a880 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c06ad50 con 0x7fa18c06a900 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa193200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15a580 con 0x7fa18c153320 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa191200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18c0a9fe0 0x7fa18c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa191200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa18c0a9fe0 0x7fa18c15ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39392/0 (socket says 172.21.15.46:39392) 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa191200640 1 -- 172.21.15.46:0/2406391944 learned_addr learned my addr 172.21.15.46:0/2406391944 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa18be00640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c06a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.530+0000 7fa183e00640 1 --2- 172.21.15.46:0/2406391944 >> v2:172.21.15.162:3300/0 conn(0x7fa18c06a900 0x7fa18c0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.531+0000 7fa191200640 1 -- 172.21.15.46:0/2406391944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 msgr2=0x7fa18c06a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.531+0000 7fa191200640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c06a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.531+0000 7fa191200640 1 -- 172.21.15.46:0/2406391944 >> v2:172.21.15.162:3300/0 conn(0x7fa18c06a900 msgr2=0x7fa18c0a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.531+0000 7fa191200640 1 --2- 172.21.15.46:0/2406391944 >> v2:172.21.15.162:3300/0 conn(0x7fa18c06a900 0x7fa18c0a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.531+0000 7fa191200640 1 -- 172.21.15.46:0/2406391944 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0aa7f0 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.532+0000 7fa191200640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c15ad10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06bc20 tx=0x7fa184009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0eab6c9df7b989 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.532+0000 7fa18b400640 1 -- 172.21.15.46:0/2406391944 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184031400 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.532+0000 7fa18b400640 1 -- 172.21.15.46:0/2406391944 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18402d050 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.532+0000 7fa18b400640 1 -- 172.21.15.46:0/2406391944 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840317d0 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 -- 172.21.15.46:0/2406391944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c0a9fe0 msgr2=0x7fa18c15ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c15ad10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06bc20 tx=0x7fa184009840 comp rx=0 tx=0).stop 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 -- 172.21.15.46:0/2406391944 shutdown_connections 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c15ad10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 --2- 172.21.15.46:0/2406391944 >> v2:172.21.15.162:3300/0 conn(0x7fa18c06a900 0x7fa18c0a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 --2- 172.21.15.46:0/2406391944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c06a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 -- 172.21.15.46:0/2406391944 >> 172.21.15.46:0/2406391944 conn(0x7fa18c06cb20 msgr2=0x7fa18c068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 -- 172.21.15.46:0/2406391944 shutdown_connections 2024-08-17T02:28:33.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.533+0000 7fa193200640 1 -- 172.21.15.46:0/2406391944 wait complete. 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.534+0000 7fa193200640 1 Processor -- start 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.534+0000 7fa193200640 1 -- start start 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15d9b0 con 0x7fa18c06a900 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15e250 con 0x7fa18c0a9fe0 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa193200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c14fcd0 con 0x7fa18c153320 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa18be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa18be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39406/0 (socket says 172.21.15.46:39406) 2024-08-17T02:28:33.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa18be00640 1 -- 172.21.15.46:0/1899266969 learned_addr learned my addr 172.21.15.46:0/1899266969 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.535+0000 7fa191200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa183e00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 -- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 msgr2=0x7fa18c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 -- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 msgr2=0x7fa18c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 -- 172.21.15.46:0/1899266969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009ae0 con 0x7fa18c06a900 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa183e00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa191200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa18be00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e960 tx=0x7fa17c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00c8e0 con 0x7fa18c06a900 2024-08-17T02:28:33.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c00ca40 con 0x7fa18c06a900 2024-08-17T02:28:33.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00cdc0 con 0x7fa18c06a900 2024-08-17T02:28:33.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.536+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c0ae2b0 con 0x7fa18c06a900 2024-08-17T02:28:33.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.537+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c15dee0 con 0x7fa18c06a900 2024-08-17T02:28:33.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.538+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c0710c0 con 0x7fa18c06a900 2024-08-17T02:28:33.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.539+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa17c013680 con 0x7fa18c06a900 2024-08-17T02:28:33.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.539+0000 7fa183400640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 0x7fa168067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.540+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa17c082730 con 0x7fa18c06a900 2024-08-17T02:28:33.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.540+0000 7fa183e00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 0x7fa168067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.541+0000 7fa183e00640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 0x7fa168067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06a1c0 tx=0x7fa174008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.543+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa17c050810 con 0x7fa18c06a900 2024-08-17T02:28:33.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.792+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa18c0b0c80 con 0x7fa18c06a900 2024-08-17T02:28:33.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.796+0000 7fa183400640 1 -- 172.21.15.46:0/1899266969 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa17c053e30 con 0x7fa18c06a900 2024-08-17T02:28:33.797 INFO:teuthology.orchestra.run.smithi046.stderr:updated caps for client.0 2024-08-17T02:28:33.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.798+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 msgr2=0x7fa168067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.798+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 0x7fa168067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06a1c0 tx=0x7fa174008040 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.798+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 msgr2=0x7fa18c14f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.798+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e960 tx=0x7fa17c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 shutdown_connections 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa168065150 0x7fa168067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa18c153320 0x7fa18c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa18c0a9fe0 0x7fa18c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 --2- 172.21.15.46:0/1899266969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa18c06a900 0x7fa18c14f790 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 >> 172.21.15.46:0/1899266969 conn(0x7fa18c06cb20 msgr2=0x7fa18c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 shutdown_connections 2024-08-17T02:28:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.799+0000 7fa193200640 1 -- 172.21.15.46:0/1899266969 wait complete. 2024-08-17T02:28:33.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:33.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.965+0000 7f1818600640 1 Processor -- start 2024-08-17T02:28:33.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.965+0000 7f1818600640 1 -- start start 2024-08-17T02:28:33.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1818600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f18100caa40 0x7f18100ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1818600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1810159350 0x7f18100ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1818600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100cb560 con 0x7f1810158f80 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1818600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100cf7e0 con 0x7f1810159350 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1818600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100cfac0 con 0x7f18100caa40 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1816600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1810159350 0x7f18100ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1816600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1810159350 0x7f18100ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39416/0 (socket says 172.21.15.46:39416) 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.966+0000 7f1816600640 1 -- 172.21.15.46:0/2469162686 learned_addr learned my addr 172.21.15.46:0/2469162686 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.967+0000 7f1815200640 1 --2- 172.21.15.46:0/2469162686 >> v2:172.21.15.162:3300/0 conn(0x7f18100caa40 0x7f18100ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.967+0000 7f1816600640 1 -- 172.21.15.46:0/2469162686 >> v2:172.21.15.162:3300/0 conn(0x7f18100caa40 msgr2=0x7f18100ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.967+0000 7f1816600640 1 --2- 172.21.15.46:0/2469162686 >> v2:172.21.15.162:3300/0 conn(0x7f18100caa40 0x7f18100ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.967+0000 7f1816600640 1 -- 172.21.15.46:0/2469162686 >> v1:172.21.15.162:6789/0 conn(0x7f1810158f80 legacy=0x7f18100ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.967+0000 7f1816600640 1 -- 172.21.15.46:0/2469162686 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100caf10 con 0x7f1810159350 2024-08-17T02:28:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.968+0000 7f1816600640 1 --2- 172.21.15.46:0/2469162686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159350 0x7f18100ad380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1810089c80 tx=0x7f1808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549102e3a6669d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.968+0000 7f180fe00640 1 -- 172.21.15.46:0/2469162686 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808031400 con 0x7f1810159350 2024-08-17T02:28:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.968+0000 7f180fe00640 1 -- 172.21.15.46:0/2469162686 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180802d050 con 0x7f1810159350 2024-08-17T02:28:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.968+0000 7f180fe00640 1 -- 172.21.15.46:0/2469162686 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080317d0 con 0x7f1810159350 2024-08-17T02:28:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 -- 172.21.15.46:0/2469162686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159350 msgr2=0x7f18100ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 --2- 172.21.15.46:0/2469162686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159350 0x7f18100ad380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1810089c80 tx=0x7f1808009840 comp rx=0 tx=0).stop 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 -- 172.21.15.46:0/2469162686 shutdown_connections 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 --2- 172.21.15.46:0/2469162686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810159350 0x7f18100ad380 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 --2- 172.21.15.46:0/2469162686 >> v2:172.21.15.162:3300/0 conn(0x7f18100caa40 0x7f18100ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 -- 172.21.15.46:0/2469162686 >> 172.21.15.46:0/2469162686 conn(0x7f18100cfd90 msgr2=0x7f18100d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 -- 172.21.15.46:0/2469162686 shutdown_connections 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.969+0000 7f1818600640 1 -- 172.21.15.46:0/2469162686 wait complete. 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.970+0000 7f1818600640 1 Processor -- start 2024-08-17T02:28:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.970+0000 7f1818600640 1 -- start start 2024-08-17T02:28:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18100caa40 0x7f18101551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1810159350 0x7f18100b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ca620 con 0x7f1810158f80 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c9d80 con 0x7f1810159350 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.971+0000 7f1818600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100ca060 con 0x7f18100caa40 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39428/0 (socket says 172.21.15.46:39428) 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 -- 172.21.15.46:0/1278450955 learned_addr learned my addr 172.21.15.46:0/1278450955 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1816600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1810159350 0x7f18100b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815c00640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18100caa40 0x7f18101551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 -- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18100caa40 msgr2=0x7f18101551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18100caa40 0x7f18101551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 -- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1810159350 msgr2=0x7f18100b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1810159350 0x7f18100b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 -- 172.21.15.46:0/1278450955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808009ae0 con 0x7f1810158f80 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.972+0000 7f1815200640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00d860 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.973+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0096a0 con 0x7f1810158f80 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.973+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc009800 con 0x7f1810158f80 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.973+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc009bc0 con 0x7f1810158f80 2024-08-17T02:28:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.973+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100ca340 con 0x7f1810158f80 2024-08-17T02:28:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.973+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1810155730 con 0x7f1810158f80 2024-08-17T02:28:33.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.974+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1810159a40 con 0x7f1810158f80 2024-08-17T02:28:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.975+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f17fc014410 con 0x7f1810158f80 2024-08-17T02:28:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.975+0000 7f180cc00640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 0x7f17f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.976+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17fc082b70 con 0x7f1810158f80 2024-08-17T02:28:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.976+0000 7f1815c00640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 0x7f17f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.977+0000 7f1815c00640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 0x7f17f0067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804007e10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:33.980+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f17fc050d00 con 0x7f1810158f80 2024-08-17T02:28:34.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.199+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1810064db0 con 0x7f1810158f80 2024-08-17T02:28:34.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.200+0000 7f180cc00640 1 -- 172.21.15.46:0/1278450955 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f17fc054320 con 0x7f1810158f80 2024-08-17T02:28:34.201 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:34.201 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4926,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:34.201 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 17 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 msgr2=0x7f17f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 0x7f17f0067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 msgr2=0x7f181015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00d860 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 shutdown_connections 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1810159350 0x7f18100b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1810158f80 0x7f181015ae00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f17f0065150 0x7f17f0067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 --2- 172.21.15.46:0/1278450955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18100caa40 0x7f18101551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 >> 172.21.15.46:0/1278450955 conn(0x7f18100cfd90 msgr2=0x7f1810068110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.202+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 shutdown_connections 2024-08-17T02:28:34.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.203+0000 7f1818600640 1 -- 172.21.15.46:0/1278450955 wait complete. 2024-08-17T02:28:34.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:28:28.130941+0000', 'modified': '2024-08-17T02:28:31.730126+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4929}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4929': {'gid': 4929, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.46:6835/1370984622', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6834', 'nonce': 1370984622}, {'type': 'v1', 'addr': '172.21.15.46:6835', 'nonce': 1370984622}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:28:34.620 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:28:34.621 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.775+0000 7f0bac600640 1 Processor -- start 2024-08-17T02:28:34.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.775+0000 7f0bac600640 1 -- start start 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0bac600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 0x7f0ba40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0bac600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ba4140580 0x7f0ba40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0bac600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40b16d0 con 0x7f0ba40b1270 2024-08-17T02:28:34.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0bac600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40cb450 con 0x7f0ba4140580 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0bac600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40caa80 con 0x7f0ba41401b0 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0ba9200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ba4140580 0x7f0ba40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.776+0000 7f0baa600640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0ba40b1270 0x7f0ba40c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38702/0 (socket says 172.21.15.46:38702) 2024-08-17T02:28:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0baa600640 1 -- 172.21.15.46:0/2329067122 learned_addr learned my addr 172.21.15.46:0/2329067122 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9200640 1 -- 172.21.15.46:0/2329067122 >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 msgr2=0x7f0ba40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/2329067122 >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 0x7f0ba40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9200640 1 --2- 172.21.15.46:0/2329067122 >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 0x7f0ba40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9200640 1 -- 172.21.15.46:0/2329067122 >> v1:172.21.15.46:6789/0 conn(0x7f0ba40b1270 legacy=0x7f0ba40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba3e00640 1 -- 172.21.15.46:0/2329067122 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608511003 0 0) 0x7f0b9c001490 con 0x7f0ba40b1270 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9200640 1 -- 172.21.15.46:0/2329067122 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40c9e70 con 0x7f0ba4140580 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.777+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/2329067122 >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 0x7f0ba40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.778+0000 7f0ba9200640 1 --2- 172.21.15.46:0/2329067122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba4140580 0x7f0ba40b0d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4068650 tx=0x7f0b900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509f594858c141c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.778+0000 7f0ba3e00640 1 -- 172.21.15.46:0/2329067122 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9002ad20 con 0x7f0ba4140580 2024-08-17T02:28:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.778+0000 7f0ba3e00640 1 -- 172.21.15.46:0/2329067122 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9002ae80 con 0x7f0ba4140580 2024-08-17T02:28:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.778+0000 7f0ba3e00640 1 -- 172.21.15.46:0/2329067122 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90032670 con 0x7f0ba4140580 2024-08-17T02:28:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 -- 172.21.15.46:0/2329067122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba4140580 msgr2=0x7f0ba40b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 --2- 172.21.15.46:0/2329067122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba4140580 0x7f0ba40b0d30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4068650 tx=0x7f0b900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 -- 172.21.15.46:0/2329067122 shutdown_connections 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 --2- 172.21.15.46:0/2329067122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba4140580 0x7f0ba40b0d30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 --2- 172.21.15.46:0/2329067122 >> v2:172.21.15.162:3300/0 conn(0x7f0ba41401b0 0x7f0ba40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 -- 172.21.15.46:0/2329067122 >> 172.21.15.46:0/2329067122 conn(0x7f0ba40cb9b0 msgr2=0x7f0ba40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 -- 172.21.15.46:0/2329067122 shutdown_connections 2024-08-17T02:28:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.779+0000 7f0bac600640 1 -- 172.21.15.46:0/2329067122 wait complete. 2024-08-17T02:28:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.780+0000 7f0bac600640 1 Processor -- start 2024-08-17T02:28:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.780+0000 7f0bac600640 1 -- start start 2024-08-17T02:28:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 0x7f0ba41264e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ba4140580 0x7f0ba413cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba413e350 con 0x7f0ba40b1270 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba413b570 con 0x7f0ba41401b0 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.781+0000 7f0bac600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba413da20 con 0x7f0ba4140580 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39454/0 (socket says 172.21.15.46:39454) 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3042281340 learned_addr learned my addr 172.21.15.46:0/3042281340 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9200640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 0x7f0ba41264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ba4140580 msgr2=0x7f0ba413cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ba4140580 0x7f0ba413cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 msgr2=0x7f0ba41264e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 0x7f0ba41264e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3042281340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90009390 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9200640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 0x7f0ba41264e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c8b0 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.782+0000 7f0ba0c00640 1 -- 172.21.15.46:0/3042281340 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800ce40 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.783+0000 7f0ba0c00640 1 -- 172.21.15.46:0/3042281340 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98007890 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.783+0000 7f0ba0c00640 1 -- 172.21.15.46:0/3042281340 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98007c10 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.783+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba413dd00 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.783+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba4126a20 con 0x7f0ba40b1270 2024-08-17T02:28:34.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.785+0000 7f0ba0c00640 1 -- 172.21.15.46:0/3042281340 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0b980113f0 con 0x7f0ba40b1270 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.785+0000 7f0ba0c00640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 0x7f0b84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.786+0000 7f0ba0c00640 1 -- 172.21.15.46:0/3042281340 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b98082480 con 0x7f0ba40b1270 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.786+0000 7f0ba9200640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 0x7f0b84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.786+0000 7f0baebbf740 1 Processor -- start 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.786+0000 7f0baebbf740 1 -- start start 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0ba9200640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 0x7f0b84067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b90034000 tx=0x7f0b90032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767aa10a0 0x55a767ae35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767a9a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767a5b380 con 0x55a767ac5a30 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767a049e0 con 0x55a767aa10a0 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a767a02170 con 0x55a767ae3b10 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.787+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39462/0 (socket says 172.21.15.46:39462) 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3426765158 learned_addr learned my addr 172.21.15.46:0/3426765158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9200640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767aa10a0 0x55a767ae35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0baa600640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767a9a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 msgr2=0x55a767a9a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767a9a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767aa10a0 msgr2=0x55a767ae35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767aa10a0 0x55a767ae35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 -- 172.21.15.46:0/3426765158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7679b1820 con 0x55a767ac5a30 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0baa600640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767a9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0b98050660 tx=0x7f0b98080860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb698db55009f675 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0b95600640 1 -- 172.21.15.46:0/3426765158 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9805b100 con 0x55a767ac5a30 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.788+0000 7f0b95600640 1 -- 172.21.15.46:0/3426765158 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98080a10 con 0x55a767ac5a30 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0b95600640 1 -- 172.21.15.46:0/3426765158 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98052500 con 0x55a767ac5a30 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 -- 172.21.15.46:0/3426765158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 msgr2=0x55a767ac5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0b98050660 tx=0x7f0b98080860 comp rx=0 tx=0).stop 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 -- 172.21.15.46:0/3426765158 shutdown_connections 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767a9a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767aa10a0 0x55a767ae35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 --2- 172.21.15.46:0/3426765158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767ac5e00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 -- 172.21.15.46:0/3426765158 >> 172.21.15.46:0/3426765158 conn(0x55a767a39030 msgr2=0x55a767ae7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 -- 172.21.15.46:0/3426765158 shutdown_connections 2024-08-17T02:28:34.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.789+0000 7f0baebbf740 1 -- 172.21.15.46:0/3426765158 wait complete. 2024-08-17T02:28:34.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.790+0000 7f0baebbf740 1 -- start start 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.790+0000 7f0baebbf740 1 Processor -- start 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ae5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767accea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7679fdf60 con 0x55a767ae3b10 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7679a6690 con 0x55a767ac5a30 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7679a6330 con 0x55a767aa10a0 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baebbf740 10 client.0 _ll_register_callbacks cb 0x55a7679a02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baa600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baa600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39472/0 (socket says 172.21.15.46:39472) 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.791+0000 7f0baa600640 1 -- 172.21.15.46:0/62694181 learned_addr learned my addr 172.21.15.46:0/62694181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0ba9200640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767accea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ae5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 -- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 msgr2=0x55a767ae5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ae5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 -- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 msgr2=0x55a767accea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767accea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 -- 172.21.15.46:0/62694181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba4126a20 con 0x55a767ae3b10 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baa600640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e910 tx=0x7f0b9c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d142b733a13168e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0b8a000640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0072e0 con 0x55a767ae3b10 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b9c007440 con 0x55a767ae3b10 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a767a31d20 con 0x55a767ae3b10 2024-08-17T02:28:34.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9c001c30 con 0x55a767ae3b10 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baebbf740 10 client.5100 fetch_fsmap learned FSMap version 17 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.792+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a7679c7ab0 con 0x55a767ae3b10 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a767a31d20 con 0x55a767ae3b10 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b9c007810 con 0x55a767ae3b10 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 10 client.5100 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 10 client.5100 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 20 client.5100 populate_metadata read hostname 'smithi046' 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767acbb90 0x55a767acbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 4 client.5100 mds_command: new command op to 4929 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 --> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7677053c0 con 0x55a767acbb90 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.793+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767acbb90 0x55a767acbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767acbb90 0x55a767acbf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=815b28898a1a647a server_cookie=616196511622928c in_seq=0 out_seq=0 2024-08-17T02:28:34.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0b8a000640 10 client.5100 ms_handle_connect on v2:172.21.15.46:6834/1370984622 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0b8a000640 1 -- 172.21.15.46:0/62694181 <== mds.0 v2:172.21.15.46:6834/1370984622 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55a7677053c0 con 0x55a767acbb90 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0b8a000640 10 client.5100 handle_command_reply: tid=0 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0baebbf740 1 client.5100 shutdown 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 msgr2=0x55a767acd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.794+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00e910 tx=0x7f0b9c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 shutdown_connections 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767acbb90 0x55a767acbf60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ae3b10 0x55a767acd3e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767accea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 --2- 172.21.15.46:0/62694181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ae5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0b8a000640 0 client.5100 ms_handle_reset on v2:172.21.15.46:6834/1370984622 2024-08-17T02:28:34.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 >> 172.21.15.46:0/62694181 conn(0x55a767a39030 msgr2=0x55a767ac91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 shutdown_connections 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 1 -- 172.21.15.46:0/62694181 wait complete. 2024-08-17T02:28:34.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.795+0000 7f0baebbf740 20 client.5100 trim_cache size 0 max 16384 2024-08-17T02:28:34.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.811+0000 7f0baebbf740 1 Processor -- start 2024-08-17T02:28:34.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.811+0000 7f0baebbf740 1 -- start start 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ac5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ae3b10 0x55a767acce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767778f20 con 0x55a767ac5a30 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767a9e330 con 0x55a767ae3b10 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a767acc790 con 0x55a767aa10a0 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39484/0 (socket says 172.21.15.46:39484) 2024-08-17T02:28:34.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 -- 172.21.15.46:0/2696776083 learned_addr learned my addr 172.21.15.46:0/2696776083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ac5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0baa600640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ae3b10 0x55a767acce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 -- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 msgr2=0x55a767ac5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ac5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 -- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ae3b10 msgr2=0x55a767acce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.812+0000 7f0ba9200640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ae3b10 0x55a767acce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0ba9200640 1 -- 172.21.15.46:0/2696776083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7679cb490 con 0x55a767ac5a30 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ac5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0ba9200640 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b90035040 tx=0x7f0b9003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89737be6d3cb1ca9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0b96000640 1 -- 172.21.15.46:0/2696776083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90048480 con 0x55a767ac5a30 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0b96000640 1 -- 172.21.15.46:0/2696776083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900485e0 con 0x55a767ac5a30 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.813+0000 7f0b96000640 1 -- 172.21.15.46:0/2696776083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90048960 con 0x55a767ac5a30 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- 172.21.15.46:0/2696776083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 msgr2=0x55a767af2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b90035040 tx=0x7f0b9003b000 comp rx=0 tx=0).stop 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- 172.21.15.46:0/2696776083 shutdown_connections 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ae3b10 0x55a767acce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767ac5a30 0x55a767af2b70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 --2- 172.21.15.46:0/2696776083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767aa10a0 0x55a767ac5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- 172.21.15.46:0/2696776083 >> 172.21.15.46:0/2696776083 conn(0x55a767a39030 msgr2=0x55a767a955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- 172.21.15.46:0/2696776083 shutdown_connections 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- 172.21.15.46:0/2696776083 wait complete. 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.814+0000 7f0baebbf740 1 -- start start 2024-08-17T02:28:34.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 Processor -- start 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767b42e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767b433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767a9d020 con 0x55a767aa10a0 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a767ae38e0 con 0x55a767ac5a30 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.815+0000 7f0baebbf740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a767b4c710 con 0x55a767ae3b10 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0baebbf740 10 client.0 _ll_register_callbacks cb 0x7f0b9c0019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39496/0 (socket says 172.21.15.46:39496) 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 -- 172.21.15.46:0/1704752872 learned_addr learned my addr 172.21.15.46:0/1704752872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9200640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767b42e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0baa600640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767b433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 -- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 msgr2=0x55a767b433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767b433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 -- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 msgr2=0x55a767b42e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767b42e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 -- 172.21.15.46:0/1704752872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba40c9e70 con 0x55a767aa10a0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0baa600640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767b433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0ba9c00640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b98050660 tx=0x7f0b9806c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d0e75272c366a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.816+0000 7f0b8a000640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9805b100 con 0x55a767aa10a0 2024-08-17T02:28:34.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0b98052500 con 0x55a767aa10a0 2024-08-17T02:28:34.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b98080a10 con 0x55a767aa10a0 2024-08-17T02:28:34.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b980820d0 con 0x55a767aa10a0 2024-08-17T02:28:34.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 10 client.5106 fetch_fsmap learned FSMap version 17 2024-08-17T02:28:34.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a7679cb1e0 con 0x55a767aa10a0 2024-08-17T02:28:34.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b98080a10 con 0x55a767aa10a0 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0b980600e0 con 0x55a767aa10a0 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 10 client.5106 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 10 client.5106 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 20 client.5106 populate_metadata read hostname 'smithi046' 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767b449f0 0x55a767af4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 4 client.5106 mds_command: new command op to 4929 tid=0[{"prefix": "status"}] 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.817+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 --> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a7677166c0 con 0x55a767b449f0 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0ba9200640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767b449f0 0x55a767af4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0ba9200640 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767b449f0 0x55a767af4360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1752b2440f20ad3b server_cookie=dde131b4df8b7167 in_seq=0 out_seq=0 2024-08-17T02:28:34.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0b8a000640 10 client.5106 ms_handle_connect on v2:172.21.15.46:6834/1370984622 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0b8a000640 1 -- 172.21.15.46:0/1704752872 <== mds.0 v2:172.21.15.46:6834/1370984622 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a7677166c0 con 0x55a767b449f0 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0b8a000640 10 client.5106 handle_command_reply: tid=0 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0baebbf740 1 client.5106 shutdown 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 msgr2=0x55a767accfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.818+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b98050660 tx=0x7f0b9806c040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 shutdown_connections 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:6834/1370984622,v1:172.21.15.46:6835/1370984622] conn(0x55a767b449f0 0x55a767af4360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a767ae3b10 0x55a767b433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a767ac5a30 0x55a767b42e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 --2- 172.21.15.46:0/1704752872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a767aa10a0 0x55a767accfd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0b8a000640 0 client.5106 ms_handle_reset on v2:172.21.15.46:6834/1370984622 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 >> 172.21.15.46:0/1704752872 conn(0x55a767a39030 msgr2=0x55a767a95580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 shutdown_connections 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 1 -- 172.21.15.46:0/1704752872 wait complete. 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0baebbf740 20 client.5106 trim_cache size 0 max 16384 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "cdf034cd-9476-4b1b-a305-19ec575459d2", 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-08-17T02:28:34.826 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4929, 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 6.1227467649999996, 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 17, 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 32, 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 14.005298282 2024-08-17T02:28:34.827 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:28:34.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 msgr2=0x7f0b84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 0x7f0b84067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b90034000 tx=0x7f0b90032000 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 msgr2=0x7f0ba413b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.819+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800c8b0 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 shutdown_connections 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0b84065150 0x7f0b84067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ba4140580 0x7f0ba413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ba41401b0 0x7f0ba41264e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 --2- 172.21.15.46:0/3042281340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ba40b1270 0x7f0ba413b030 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 >> 172.21.15.46:0/3042281340 conn(0x7f0ba40cb9b0 msgr2=0x7f0ba40aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 shutdown_connections 2024-08-17T02:28:34.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.820+0000 7f0bac600640 1 -- 172.21.15.46:0/3042281340 wait complete. 2024-08-17T02:28:34.836 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:34.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.986+0000 7fc1f1a00640 1 Processor -- start 2024-08-17T02:28:34.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.986+0000 7fc1f1a00640 1 -- start start 2024-08-17T02:28:34.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.987+0000 7fc1f1a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1ec1401b0 0x7fc1ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.987+0000 7fc1f1a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 0x7fc1ec0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.987+0000 7fc1f1a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ec0caa80 con 0x7fc1ec140580 2024-08-17T02:28:34.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.987+0000 7fc1f1a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0cb450 con 0x7fc1ec1401b0 2024-08-17T02:28:34.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.987+0000 7fc1f1a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ec0c9e70 con 0x7fc1ec0b1440 2024-08-17T02:28:34.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1ec1401b0 0x7fc1ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc1ec1401b0 0x7fc1ec0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39504/0 (socket says 172.21.15.46:39504) 2024-08-17T02:28:34.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 -- 172.21.15.46:0/3393155966 learned_addr learned my addr 172.21.15.46:0/3393155966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eb400640 1 --2- 172.21.15.46:0/3393155966 >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 0x7fc1ec0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 -- 172.21.15.46:0/3393155966 >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 msgr2=0x7fc1ec0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 --2- 172.21.15.46:0/3393155966 >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 0x7fc1ec0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 -- 172.21.15.46:0/3393155966 >> v1:172.21.15.162:6789/0 conn(0x7fc1ec140580 legacy=0x7fc1ec0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eaa00640 1 -- 172.21.15.46:0/3393155966 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec0ca150 con 0x7fc1ec1401b0 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.988+0000 7fc1eb400640 1 --2- 172.21.15.46:0/3393155966 >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 0x7fc1ec0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.989+0000 7fc1eaa00640 1 --2- 172.21.15.46:0/3393155966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec0caf10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ca9f0 tx=0x7fc1dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcca0f2ff84a679 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.989+0000 7fc1ea000640 1 -- 172.21.15.46:0/3393155966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc02ad40 con 0x7fc1ec1401b0 2024-08-17T02:28:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.989+0000 7fc1ea000640 1 -- 172.21.15.46:0/3393155966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc032440 con 0x7fc1ec1401b0 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.989+0000 7fc1ea000640 1 -- 172.21.15.46:0/3393155966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc02aea0 con 0x7fc1ec1401b0 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 -- 172.21.15.46:0/3393155966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 msgr2=0x7fc1ec0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/3393155966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec0caf10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec0ca9f0 tx=0x7fc1dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 -- 172.21.15.46:0/3393155966 shutdown_connections 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/3393155966 >> v2:172.21.15.162:3300/0 conn(0x7fc1ec0b1440 0x7fc1ec0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/3393155966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec0caf10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 -- 172.21.15.46:0/3393155966 >> 172.21.15.46:0/3393155966 conn(0x7fc1ec0cb9b0 msgr2=0x7fc1ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 -- 172.21.15.46:0/3393155966 shutdown_connections 2024-08-17T02:28:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.990+0000 7fc1f1a00640 1 -- 172.21.15.46:0/3393155966 wait complete. 2024-08-17T02:28:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.991+0000 7fc1f1a00640 1 Processor -- start 2024-08-17T02:28:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 -- start start 2024-08-17T02:28:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1ec0b1440 0x7fc1ec169440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1ec140580 0x7fc1ec0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec169be0 con 0x7fc1ec1401b0 2024-08-17T02:28:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec169980 con 0x7fc1ec0b1440 2024-08-17T02:28:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.992+0000 7fc1f1a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ec15a040 con 0x7fc1ec140580 2024-08-17T02:28:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39516/0 (socket says 172.21.15.46:39516) 2024-08-17T02:28:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 -- 172.21.15.46:0/1413456475 learned_addr learned my addr 172.21.15.46:0/1413456475 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1eaa00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1ec0b1440 0x7fc1ec169440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1eb400640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1ec140580 0x7fc1ec0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 -- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1ec140580 msgr2=0x7fc1ec0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1ec140580 0x7fc1ec0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 -- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1ec0b1440 msgr2=0x7fc1ec169440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1ec0b1440 0x7fc1ec169440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.993+0000 7fc1e3e00640 1 -- 172.21.15.46:0/1413456475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009450 con 0x7fc1ec1401b0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1e3e00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c5e0 tx=0x7fc1d4007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4012630 con 0x7fc1ec1401b0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40127b0 con 0x7fc1ec1401b0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4012bb0 con 0x7fc1ec1401b0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1ec15a320 con 0x7fc1ec1401b0 2024-08-17T02:28:34.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.994+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ec15a8e0 con 0x7fc1ec1401b0 2024-08-17T02:28:34.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.995+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ec15ab00 con 0x7fc1ec1401b0 2024-08-17T02:28:34.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.996+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc1d401b400 con 0x7fc1ec1401b0 2024-08-17T02:28:34.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.997+0000 7fc1e2000640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 0x7fc1c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.997+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1d4082590 con 0x7fc1ec1401b0 2024-08-17T02:28:34.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.998+0000 7fc1eaa00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 0x7fc1c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:34.998+0000 7fc1eaa00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 0x7fc1c8067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc034000 tx=0x7fc1dc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.001+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc1d4050720 con 0x7fc1ec1401b0 2024-08-17T02:28:35.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.222+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1ec064db0 con 0x7fc1ec1401b0 2024-08-17T02:28:35.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.223+0000 7fc1e2000640 1 -- 172.21.15.46:0/1413456475 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc1d4016070 con 0x7fc1ec1401b0 2024-08-17T02:28:35.224 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 msgr2=0x7fc1c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 0x7fc1c8067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc034000 tx=0x7fc1dc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 msgr2=0x7fc1ec15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400c5e0 tx=0x7fc1d4007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 shutdown_connections 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fc1c8065150 0x7fc1c8067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1ec140580 0x7fc1ec0ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1ec1401b0 0x7fc1ec15ae00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 --2- 172.21.15.46:0/1413456475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1ec0b1440 0x7fc1ec169440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 >> 172.21.15.46:0/1413456475 conn(0x7fc1ec0cb9b0 msgr2=0x7fc1ec13f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 shutdown_connections 2024-08-17T02:28:35.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:35.225+0000 7fc1f1a00640 1 -- 172.21.15.46:0/1413456475 wait complete. 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:35.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:35.242 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:35.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.242 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:35.278 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42600sec preferred_lft 42600sec 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:35.279 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 42:16:05:ba:ec:43 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::7455:16ff:fe3a:8056/64 scope link 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether c6:d8:8c:56:eb:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::c4d8:8cff:fe56:eb42/64 scope link 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 42:16:05:ba:ec:43 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::4016:5ff:feba:ec43/64 scope link 2024-08-17T02:28:35.280 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:35.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.281 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:35.371 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-08-17T02:28:35.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.374 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-08-17T02:28:35.411 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-08-17T02:28:35.411 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:35.411 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:28:35.411 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:28:35.411 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:35.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:28:35.412 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-08-17T02:28:35.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.559 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:28:35.594 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:35.594 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:35.594 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:35.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-08-17T02:28:35.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:35.691 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:35.728 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:35.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:35.728 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:35.802 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:28:35.803 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:35.803 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:35.924 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:35.950 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:28:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:28:35.951 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:28:35.952 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:28:35.952 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:35.952 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:35.952 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:35.952 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:35.955 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:35.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:35.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:36.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:36.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.161+0000 7f95b0c00640 1 Processor -- start 2024-08-17T02:28:36.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.161+0000 7f95b0c00640 1 -- start start 2024-08-17T02:28:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.162+0000 7f95b0c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f95ac155a20 0x7f95ac0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.162+0000 7f95b0c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ac06df00 0x7f95ac0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.162+0000 7f95b0c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ac156670 con 0x7f95ac155df0 2024-08-17T02:28:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.162+0000 7f95b0c00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac0b0350 con 0x7f95ac06df00 2024-08-17T02:28:36.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.162+0000 7f95b0c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ac06e5e0 con 0x7f95ac155a20 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ac06df00 0x7f95ac0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95ac06df00 0x7f95ac0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39526/0 (socket says 172.21.15.46:39526) 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 -- 172.21.15.46:0/1816873179 learned_addr learned my addr 172.21.15.46:0/1816873179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95a9e00640 1 --2- 172.21.15.46:0/1816873179 >> v2:172.21.15.162:3300/0 conn(0x7f95ac155a20 0x7f95ac0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 -- 172.21.15.46:0/1816873179 >> v2:172.21.15.162:3300/0 conn(0x7f95ac155a20 msgr2=0x7f95ac0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 --2- 172.21.15.46:0/1816873179 >> v2:172.21.15.162:3300/0 conn(0x7f95ac155a20 0x7f95ac0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 -- 172.21.15.46:0/1816873179 >> v1:172.21.15.162:6789/0 conn(0x7f95ac155df0 legacy=0x7f95ac06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.163+0000 7f95aa800640 1 -- 172.21.15.46:0/1816873179 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac06e8c0 con 0x7f95ac06df00 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.164+0000 7f95aa800640 1 --2- 172.21.15.46:0/1816873179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0ad9b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f95ac06bc00 tx=0x7f95a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4d508cd494d0c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95a9400640 1 -- 172.21.15.46:0/1816873179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031400 con 0x7f95ac06df00 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95a9400640 1 -- 172.21.15.46:0/1816873179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a402d050 con 0x7f95ac06df00 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95a9400640 1 -- 172.21.15.46:0/1816873179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40317d0 con 0x7f95ac06df00 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 -- 172.21.15.46:0/1816873179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 msgr2=0x7f95ac0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 --2- 172.21.15.46:0/1816873179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0ad9b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f95ac06bc00 tx=0x7f95a4009840 comp rx=0 tx=0).stop 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 -- 172.21.15.46:0/1816873179 shutdown_connections 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 --2- 172.21.15.46:0/1816873179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0ad9b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 --2- 172.21.15.46:0/1816873179 >> v2:172.21.15.162:3300/0 conn(0x7f95ac155a20 0x7f95ac0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 -- 172.21.15.46:0/1816873179 >> 172.21.15.46:0/1816873179 conn(0x7f95ac0cb9b0 msgr2=0x7f95ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 -- 172.21.15.46:0/1816873179 shutdown_connections 2024-08-17T02:28:36.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.165+0000 7f95b0c00640 1 -- 172.21.15.46:0/1816873179 wait complete. 2024-08-17T02:28:36.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.167+0000 7f95b0c00640 1 Processor -- start 2024-08-17T02:28:36.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.167+0000 7f95b0c00640 1 -- start start 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95ac155a20 0x7f95ac0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95ac155df0 0x7f95ac0aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0ad770 con 0x7f95ac06df00 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac152f30 con 0x7f95ac155a20 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95b0c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac0ad210 con 0x7f95ac155df0 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39532/0 (socket says 172.21.15.46:39532) 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 -- 172.21.15.46:0/952744043 learned_addr learned my addr 172.21.15.46:0/952744043 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95aa800640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95ac155df0 0x7f95ac0aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a3e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95ac155a20 0x7f95ac0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 -- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95ac155df0 msgr2=0x7f95ac0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95ac155df0 0x7f95ac0aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 -- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95ac155a20 msgr2=0x7f95ac0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95ac155a20 0x7f95ac0accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.168+0000 7f95a9e00640 1 -- 172.21.15.46:0/952744043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009ae0 con 0x7f95ac06df00 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95a9e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d8c0 tx=0x7f959c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00de50 con 0x7f95ac06df00 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c00b8d0 con 0x7f95ac06df00 2024-08-17T02:28:36.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac0ad490 con 0x7f95ac06df00 2024-08-17T02:28:36.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c00bc90 con 0x7f95ac06df00 2024-08-17T02:28:36.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.169+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac152bc0 con 0x7f95ac06df00 2024-08-17T02:28:36.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.170+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac064db0 con 0x7f95ac06df00 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.171+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f959c01e460 con 0x7f95ac06df00 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.172+0000 7f95a1600640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 0x7f9588067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.172+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f959c082b90 con 0x7f95ac06df00 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.172+0000 7f95a3e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 0x7f9588067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.173+0000 7f95a3e00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 0x7f9588067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95ac15e3f0 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.176+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f959c050c60 con 0x7f95ac06df00 2024-08-17T02:28:36.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.395+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95ac15a860 con 0x7f95ac06df00 2024-08-17T02:28:36.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.396+0000 7f95a1600640 1 -- 172.21.15.46:0/952744043 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f959c054280 con 0x7f95ac06df00 2024-08-17T02:28:36.397 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 msgr2=0x7f9588067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 0x7f9588067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f95ac15e3f0 tx=0x7f9594009040 comp rx=0 tx=0).stop 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 msgr2=0x7f95ac0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d8c0 tx=0x7f959c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 shutdown_connections 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9588065150 0x7f9588067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95ac155df0 0x7f95ac0aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95ac155a20 0x7f95ac0accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 --2- 172.21.15.46:0/952744043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95ac06df00 0x7f95ac0cb360 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 >> 172.21.15.46:0/952744043 conn(0x7f95ac0cb9b0 msgr2=0x7f95ac154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 shutdown_connections 2024-08-17T02:28:36.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:36.398+0000 7f95b0c00640 1 -- 172.21.15.46:0/952744043 wait complete. 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:36.414 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:36.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:36.415 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:36.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.415 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.456 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42603sec preferred_lft 42603sec 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.457 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0e:07:fa:f2:c5:b7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::b422:d6ff:fed6:bcc2/64 scope link 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6e:5d:91:6b:3b:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6c5d:91ff:fe6b:3b0b/64 scope link 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0e:07:fa:f2:c5:b7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c07:faff:fef2:c5b7/64 scope link 2024-08-17T02:28:36.458 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:36.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.459 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:36.555 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-08-17T02:28:36.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.558 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-08-17T02:28:36.597 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-08-17T02:28:36.597 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:36.597 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:36.597 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:36.597 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:36.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:36.598 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-08-17T02:28:36.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.747 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:28:36.782 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:36.782 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:36.783 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:36.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:36.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-08-17T02:28:36.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:36.881 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:36.916 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:36.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:36.916 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:36.991 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:28:36.991 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:36.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:37.114 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:37.115 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with new device syntax: 1@cdf034cd-9476-4b1b-a305-19ec575459d2.cephfs=/ 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.46:3300/172.21.15.162:3300/172.21.15.162:3301" will pass to kernel 2024-08-17T02:28:37.143 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:28:37.143 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:37.143 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:37.143 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:37.143 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:37.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:37.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:37.146 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:37.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:28:37.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.358+0000 7f10e6400640 1 Processor -- start 2024-08-17T02:28:37.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.359+0000 7f10e6400640 1 -- start start 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10e6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 0x7f10e0163a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10e6400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00d0a80 con 0x7f10e00b5740 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10e6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e00b2130 con 0x7f10e00b2bb0 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10e6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e00b23f0 con 0x7f10e015c4b0 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10dfe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f10e00b5740 0x7f10e015bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38710/0 (socket says 172.21.15.46:38710) 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10dfe00640 1 -- 172.21.15.46:0/212624465 learned_addr learned my addr 172.21.15.46:0/212624465 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:37.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10e5a00640 1 --2- 172.21.15.46:0/212624465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 0x7f10e0163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.360+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292386599 0 0) 0x7f10e00d0a80 con 0x7f10e00b5740 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c80034e0 con 0x7f10e00b5740 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166693290 0 0) 0x7f10e00b2130 con 0x7f10e00b2bb0 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e00d0a80 con 0x7f10e00b2bb0 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10e5a00640 1 -- 172.21.15.46:0/212624465 >> v1:172.21.15.162:6789/0 conn(0x7f10e00b2bb0 legacy=0x7f10e00b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10e5a00640 1 -- 172.21.15.46:0/212624465 >> v1:172.21.15.46:6789/0 conn(0x7f10e00b5740 legacy=0x7f10e015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.361+0000 7f10e5a00640 1 -- 172.21.15.46:0/212624465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00b37a0 con 0x7f10e015c4b0 2024-08-17T02:28:37.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.362+0000 7f10e5a00640 1 --2- 172.21.15.46:0/212624465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 0x7f10e0163a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009e90 tx=0x7f10d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f294ee9c556d87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.362+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8032420 con 0x7f10e015c4b0 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.362+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d8032580 con 0x7f10e015c4b0 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.362+0000 7f10df400640 1 -- 172.21.15.46:0/212624465 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8032900 con 0x7f10e015c4b0 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 -- 172.21.15.46:0/212624465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 msgr2=0x7f10e0163a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 --2- 172.21.15.46:0/212624465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 0x7f10e0163a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009e90 tx=0x7f10d8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 -- 172.21.15.46:0/212624465 shutdown_connections 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 --2- 172.21.15.46:0/212624465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e015c4b0 0x7f10e0163a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 -- 172.21.15.46:0/212624465 >> 172.21.15.46:0/212624465 conn(0x7f10e00cfbc0 msgr2=0x7f10e00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 -- 172.21.15.46:0/212624465 shutdown_connections 2024-08-17T02:28:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.363+0000 7f10e6400640 1 -- 172.21.15.46:0/212624465 wait complete. 2024-08-17T02:28:37.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.364+0000 7f10e6400640 1 Processor -- start 2024-08-17T02:28:37.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.364+0000 7f10e6400640 1 -- start start 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 0x7f10e0154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e015c4b0 0x7f10e00b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01688d0 con 0x7f10e015c4b0 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01562b0 con 0x7f10e00b5740 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e6400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0155a10 con 0x7f10e00b2bb0 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e5a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e015c4b0 0x7f10e00b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.365+0000 7f10e5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 0x7f10e0154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:41394/0 (socket says 172.21.15.46:41394) 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10e5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 0x7f10e0154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:38724/0 (socket says 172.21.15.46:38724) 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 -- 172.21.15.46:0/152928801 learned_addr learned my addr 172.21.15.46:0/152928801 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 -- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 msgr2=0x7f10e0154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 0x7f10e0154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 -- 172.21.15.46:0/152928801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e015c4b0 msgr2=0x7f10e00b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e015c4b0 0x7f10e00b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 -- 172.21.15.46:0/152928801 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009a20 con 0x7f10e00b5740 2024-08-17T02:28:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.366+0000 7f10dfe00640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10cc005840 tx=0x7f10cc007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.367+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc005aa0 con 0x7f10e00b5740 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.367+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc005c00 con 0x7f10e00b5740 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.367+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0070f0 con 0x7f10e00b5740 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.367+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0155cf0 con 0x7f10e00b5740 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.367+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e0168ae0 con 0x7f10e00b5740 2024-08-17T02:28:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.368+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e0168d00 con 0x7f10e00b5740 2024-08-17T02:28:37.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.369+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f10cc007520 con 0x7f10e00b5740 2024-08-17T02:28:37.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.370+0000 7f10d3e00640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 0x7f10c0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.370+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10cc081d70 con 0x7f10e00b5740 2024-08-17T02:28:37.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.371+0000 7f10e5000640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 0x7f10c0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.371+0000 7f10e5000640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 0x7f10c0067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10d4003a10 tx=0x7f10d4007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.376+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f10cc050020 con 0x7f10e00b5740 2024-08-17T02:28:37.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.596+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10e0071050 con 0x7f10e00b5740 2024-08-17T02:28:37.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.760+0000 7f10d3e00640 1 -- 172.21.15.46:0/152928801 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f10cc053640 con 0x7f10e00b5740 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 msgr2=0x7f10c0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 0x7f10c0067630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10d4003a10 tx=0x7f10d4007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 msgr2=0x7f10e0155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10cc005840 tx=0x7f10cc007df0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 shutdown_connections 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10e015c4b0 0x7f10e00b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e00b5740 0x7f10e0155170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f10c0065180 0x7f10c0067630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 --2- 172.21.15.46:0/152928801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e00b2bb0 0x7f10e0154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.762+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 >> 172.21.15.46:0/152928801 conn(0x7f10e00cfbc0 msgr2=0x7f10e00abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.763+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 shutdown_connections 2024-08-17T02:28:37.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.763+0000 7f10e6400640 1 -- 172.21.15.46:0/152928801 wait complete. 2024-08-17T02:28:37.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:37.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.931+0000 7f2b8fa00640 1 Processor -- start 2024-08-17T02:28:37.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.931+0000 7f2b8fa00640 1 -- start start 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.932+0000 7f2b8fa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b88155a20 0x7f2b880adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.932+0000 7f2b8fa00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b88156670 con 0x7f2b88155df0 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.932+0000 7f2b8fa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8806e5e0 con 0x7f2b8806df00 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.932+0000 7f2b8fa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880b0350 con 0x7f2b88155a20 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2b88155df0 0x7f2b8806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38720/0 (socket says 172.21.15.46:38720) 2024-08-17T02:28:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87e00640 1 -- 172.21.15.46:0/1158221504 learned_addr learned my addr 172.21.15.46:0/1158221504 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:37.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b8d000640 1 --2- 172.21.15.46:0/1158221504 >> v2:172.21.15.162:3300/0 conn(0x7f2b88155a20 0x7f2b880adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739689801 0 0) 0x7f2b88156670 con 0x7f2b88155df0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b700034e0 con 0x7f2b88155df0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173317158 0 0) 0x7f2b8806e5e0 con 0x7f2b8806df00 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88156670 con 0x7f2b8806df00 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735045856 0 0) 0x7f2b700034e0 con 0x7f2b88155df0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 >> v2:172.21.15.162:3300/0 conn(0x7f2b88155a20 msgr2=0x7f2b880adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 --2- 172.21.15.46:0/1158221504 >> v2:172.21.15.162:3300/0 conn(0x7f2b88155a20 0x7f2b880adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 >> v1:172.21.15.162:6789/0 conn(0x7f2b8806df00 legacy=0x7f2b88156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8806e8c0 con 0x7f2b88155df0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7f2b74001470 con 0x7f2b88155df0 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.933+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 >> v1:172.21.15.46:6789/0 conn(0x7f2b88155df0 legacy=0x7f2b8806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 0x7f2b70003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70004780 0x7f2b70004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b70005180 0x7f2b7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7000c0f0 con 0x7f2b70003bb0 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7000c260 con 0x7f2b70005180 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7000c420 con 0x7f2b70004780 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 0x7f2b70003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b87e00640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70004780 0x7f2b70004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8da00640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b70005180 0x7f2b7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 -- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70004780 msgr2=0x7f2b70004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70004780 0x7f2b70004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 -- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b70005180 msgr2=0x7f2b7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b70005180 0x7f2b7000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8d000640 1 -- 172.21.15.46:0/1158221504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700034e0 con 0x7f2b70003bb0 2024-08-17T02:28:37.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.934+0000 7f2b8da00640 1 -- 172.21.15.46:0/1158221504 reap_dead start 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.935+0000 7f2b8d000640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 0x7f2b70003fa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c006e70 tx=0x7f2b7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f88d48f0253f684 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c031400 con 0x7f2b70003bb0 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c02d050 con 0x7f2b70003bb0 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b87400640 1 -- 172.21.15.46:0/1158221504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c031790 con 0x7f2b70003bb0 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 -- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 msgr2=0x7f2b70003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 0x7f2b70003fa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c006e70 tx=0x7f2b7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 -- 172.21.15.46:0/1158221504 shutdown_connections 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/1158221504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b70003bb0 0x7f2b70003fa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 -- 172.21.15.46:0/1158221504 >> 172.21.15.46:0/1158221504 conn(0x7f2b880cb9b0 msgr2=0x7f2b880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 -- 172.21.15.46:0/1158221504 shutdown_connections 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.936+0000 7f2b8fa00640 1 -- 172.21.15.46:0/1158221504 wait complete. 2024-08-17T02:28:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.938+0000 7f2b8fa00640 1 Processor -- start 2024-08-17T02:28:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.938+0000 7f2b8fa00640 1 -- start start 2024-08-17T02:28:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 0x7f2b8816a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806cea0 0x7f2b8806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880ac4f0 con 0x7f2b881443b0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8806d830 con 0x7f2b8806cea0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8fa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880ab8e0 con 0x7f2b70003bb0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39564/0 (socket says 172.21.15.46:39564) 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 -- 172.21.15.46:0/792542023 learned_addr learned my addr 172.21.15.46:0/792542023 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8d000640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 0x7f2b8816a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8da00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806cea0 0x7f2b8806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 -- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 msgr2=0x7f2b8816a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 0x7f2b8816a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 -- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806cea0 msgr2=0x7f2b8806d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806cea0 0x7f2b8806d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 -- 172.21.15.46:0/792542023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880abbc0 con 0x7f2b881443b0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b8d000640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 0x7f2b8816a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.939+0000 7f2b87e00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b74001120 tx=0x7f2b74001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.940+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74018030 con 0x7f2b881443b0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.940+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74007740 con 0x7f2b881443b0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.940+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400fc10 con 0x7f2b881443b0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.940+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b880abea0 con 0x7f2b881443b0 2024-08-17T02:28:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.940+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b88144820 con 0x7f2b881443b0 2024-08-17T02:28:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.941+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b880ac660 con 0x7f2b881443b0 2024-08-17T02:28:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.942+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2b7401b070 con 0x7f2b881443b0 2024-08-17T02:28:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.943+0000 7f2b7be00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.943+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b74019070 con 0x7f2b881443b0 2024-08-17T02:28:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.943+0000 7f2b8d000640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.944+0000 7f2b8d000640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c034000 tx=0x7f2b7c035000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:37.947+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2b740503c0 con 0x7f2b881443b0 2024-08-17T02:28:38.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.160+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b88064db0 con 0x7f2b68065150 2024-08-17T02:28:38.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.162+0000 7f2b7be00640 1 -- 172.21.15.46:0/792542023 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2b88064db0 con 0x7f2b68065150 2024-08-17T02:28:38.162 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-08-17T02:28:38.163 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:38.163 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2024-08-17T02:28:38.163 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:38.163 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 msgr2=0x7f2b68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 0x7f2b68067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c034000 tx=0x7f2b7c035000 comp rx=0 tx=0).stop 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 msgr2=0x7f2b880c16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b74001120 tx=0x7f2b74001d40 comp rx=0 tx=0).stop 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 shutdown_connections 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b8806cea0 0x7f2b8806d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b881443b0 0x7f2b880c16c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f2b68065150 0x7f2b68067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 --2- 172.21.15.46:0/792542023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b70003bb0 0x7f2b8816a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 >> 172.21.15.46:0/792542023 conn(0x7f2b880cb9b0 msgr2=0x7f2b88152440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 shutdown_connections 2024-08-17T02:28:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.164+0000 7f2b8fa00640 1 -- 172.21.15.46:0/792542023 wait complete. 2024-08-17T02:28:38.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:38.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.333+0000 7fdea2a00640 1 Processor -- start 2024-08-17T02:28:38.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.333+0000 7fdea2a00640 1 -- start start 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.334+0000 7fdea2a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde9c06a3c0 0x7fde9c0ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.334+0000 7fdea2a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde9c0c9b40 0x7fde9c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.334+0000 7fdea2a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c0cacf0 con 0x7fde9c0acf40 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.334+0000 7fdea2a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c0ad850 con 0x7fde9c06a3c0 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.334+0000 7fdea2a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c0ca0e0 con 0x7fde9c0c9b40 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde9be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde9c0acf40 0x7fde9c0cb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38726/0 (socket says 172.21.15.46:38726) 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde9be00640 1 -- 172.21.15.46:0/2402051064 learned_addr learned my addr 172.21.15.46:0/2402051064 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde93e00640 1 --2- 172.21.15.46:0/2402051064 >> v2:172.21.15.46:3300/0 conn(0x7fde9c06a3c0 0x7fde9c0ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fdea0a00640 1 --2- 172.21.15.46:0/2402051064 >> v2:172.21.15.162:3300/0 conn(0x7fde9c0c9b40 0x7fde9c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde9b400640 1 -- 172.21.15.46:0/2402051064 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322036432 0 0) 0x7fde9c0cacf0 con 0x7fde9c0acf40 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde9b400640 1 -- 172.21.15.46:0/2402051064 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde800034e0 con 0x7fde9c0acf40 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde93e00640 1 -- 172.21.15.46:0/2402051064 >> v2:172.21.15.162:3300/0 conn(0x7fde9c0c9b40 msgr2=0x7fde9c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde93e00640 1 --2- 172.21.15.46:0/2402051064 >> v2:172.21.15.162:3300/0 conn(0x7fde9c0c9b40 0x7fde9c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde93e00640 1 -- 172.21.15.46:0/2402051064 >> v1:172.21.15.46:6789/0 conn(0x7fde9c0acf40 legacy=0x7fde9c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.335+0000 7fde93e00640 1 -- 172.21.15.46:0/2402051064 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c0ca3c0 con 0x7fde9c06a3c0 2024-08-17T02:28:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.336+0000 7fde93e00640 1 --2- 172.21.15.46:0/2402051064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c06a3c0 0x7fde9c0ad310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0c8630 tx=0x7fde840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0944b33ad5c7dd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fde9b400640 1 -- 172.21.15.46:0/2402051064 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8402adb0 con 0x7fde9c06a3c0 2024-08-17T02:28:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fde9b400640 1 -- 172.21.15.46:0/2402051064 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84032440 con 0x7fde9c06a3c0 2024-08-17T02:28:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fde9b400640 1 -- 172.21.15.46:0/2402051064 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84032820 con 0x7fde9c06a3c0 2024-08-17T02:28:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 -- 172.21.15.46:0/2402051064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c06a3c0 msgr2=0x7fde9c0ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 --2- 172.21.15.46:0/2402051064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c06a3c0 0x7fde9c0ad310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0c8630 tx=0x7fde840090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 -- 172.21.15.46:0/2402051064 shutdown_connections 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 --2- 172.21.15.46:0/2402051064 >> v2:172.21.15.162:3300/0 conn(0x7fde9c0c9b40 0x7fde9c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 --2- 172.21.15.46:0/2402051064 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c06a3c0 0x7fde9c0ad310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 -- 172.21.15.46:0/2402051064 >> 172.21.15.46:0/2402051064 conn(0x7fde9c0686c0 msgr2=0x7fde9c068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 -- 172.21.15.46:0/2402051064 shutdown_connections 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.337+0000 7fdea2a00640 1 -- 172.21.15.46:0/2402051064 wait complete. 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.339+0000 7fdea2a00640 1 Processor -- start 2024-08-17T02:28:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.339+0000 7fdea2a00640 1 -- start start 2024-08-17T02:28:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde9c06a3c0 0x7fde9c0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9c0c9b40 0x7fde9c0c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c149b50 con 0x7fde9c0acf40 2024-08-17T02:28:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c1585c0 con 0x7fde9c0c9b40 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea2a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c1579b0 con 0x7fde9c06a3c0 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39580/0 (socket says 172.21.15.46:39580) 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 -- 172.21.15.46:0/1736374859 learned_addr learned my addr 172.21.15.46:0/1736374859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde9be00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde9c06a3c0 0x7fde9c0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fdea0a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9c0c9b40 0x7fde9c0c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 -- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde9c06a3c0 msgr2=0x7fde9c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde9c06a3c0 0x7fde9c0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 -- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9c0c9b40 msgr2=0x7fde9c0c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9c0c9b40 0x7fde9c0c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.340+0000 7fde93e00640 1 -- 172.21.15.46:0/1736374859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009390 con 0x7fde9c0acf40 2024-08-17T02:28:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fde93e00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fde84035040 tx=0x7fde84032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84031c20 con 0x7fde9c0acf40 2024-08-17T02:28:38.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84031d80 con 0x7fde9c0acf40 2024-08-17T02:28:38.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8403d670 con 0x7fde9c0acf40 2024-08-17T02:28:38.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c157c90 con 0x7fde9c0acf40 2024-08-17T02:28:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.341+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c158250 con 0x7fde9c0acf40 2024-08-17T02:28:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.342+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c158730 con 0x7fde9c0acf40 2024-08-17T02:28:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.343+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde84039040 con 0x7fde9c0acf40 2024-08-17T02:28:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.344+0000 7fde93400640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 0x7fde78067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.344+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde840a2290 con 0x7fde9c0acf40 2024-08-17T02:28:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.344+0000 7fde9be00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 0x7fde78067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.345+0000 7fde9be00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 0x7fde78067630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde9c15b6c0 tx=0x7fde8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.348+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde84070360 con 0x7fde9c0acf40 2024-08-17T02:28:38.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.529+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde9c071050 con 0x7fde9c0acf40 2024-08-17T02:28:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.529+0000 7fde93400640 1 -- 172.21.15.46:0/1736374859 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde84073980 con 0x7fde9c0acf40 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 msgr2=0x7fde78067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 0x7fde78067630 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fde9c15b6c0 tx=0x7fde8c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 msgr2=0x7fde9c157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fde84035040 tx=0x7fde84032000 comp rx=0 tx=0).stop 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 shutdown_connections 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde9c0c9b40 0x7fde9c0c38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde9c0acf40 0x7fde9c157040 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fde78065180 0x7fde78067630 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 --2- 172.21.15.46:0/1736374859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde9c06a3c0 0x7fde9c0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 >> 172.21.15.46:0/1736374859 conn(0x7fde9c0686c0 msgr2=0x7fde9c06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 shutdown_connections 2024-08-17T02:28:38.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.531+0000 7fdea2a00640 1 -- 172.21.15.46:0/1736374859 wait complete. 2024-08-17T02:28:38.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000237964 2024-08-17T02:28:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.699+0000 7ff87be00640 1 Processor -- start 2024-08-17T02:28:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.700+0000 7ff87be00640 1 -- start start 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff87be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff87c0aefb0 0x7ff87c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff87be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c068c10 con 0x7ff87c0ae5b0 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff87be00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c0af8c0 con 0x7ff87c15c7c0 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff87be00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c0697b0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff873e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff87c0ae5b0 0x7ff87c0690a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:38730/0 (socket says 172.21.15.46:38730) 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff873e00640 1 -- 172.21.15.46:0/2955232320 learned_addr learned my addr 172.21.15.46:0/2955232320 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.701+0000 7ff87aa00640 1 --2- 172.21.15.46:0/2955232320 >> v2:172.21.15.162:3300/0 conn(0x7ff87c0aefb0 0x7ff87c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.702+0000 7ff87a000640 1 -- 172.21.15.46:0/2955232320 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188850845 0 0) 0x7ff87c068c10 con 0x7ff87c0ae5b0 2024-08-17T02:28:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.702+0000 7ff87a000640 1 -- 172.21.15.46:0/2955232320 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8600034e0 con 0x7ff87c0ae5b0 2024-08-17T02:28:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.702+0000 7ff87aa00640 1 -- 172.21.15.46:0/2955232320 >> v1:172.21.15.162:6789/0 conn(0x7ff87c15c7c0 legacy=0x7ff87c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.702+0000 7ff87aa00640 1 -- 172.21.15.46:0/2955232320 >> v1:172.21.15.46:6789/0 conn(0x7ff87c0ae5b0 legacy=0x7ff87c0690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.702+0000 7ff87aa00640 1 -- 172.21.15.46:0/2955232320 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c067d60 con 0x7ff87c0aefb0 2024-08-17T02:28:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.703+0000 7ff87aa00640 1 --2- 172.21.15.46:0/2955232320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0af380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009850 tx=0x7ff86c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670edf2d66827d9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.703+0000 7ff87a000640 1 -- 172.21.15.46:0/2955232320 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c02adb0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87a000640 1 -- 172.21.15.46:0/2955232320 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c032440 con 0x7ff87c0aefb0 2024-08-17T02:28:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87a000640 1 -- 172.21.15.46:0/2955232320 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0327e0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 -- 172.21.15.46:0/2955232320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0aefb0 msgr2=0x7ff87c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 --2- 172.21.15.46:0/2955232320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0af380 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009850 tx=0x7ff86c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 -- 172.21.15.46:0/2955232320 shutdown_connections 2024-08-17T02:28:38.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 --2- 172.21.15.46:0/2955232320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0af380 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 -- 172.21.15.46:0/2955232320 >> 172.21.15.46:0/2955232320 conn(0x7ff87c096a70 msgr2=0x7ff87c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 -- 172.21.15.46:0/2955232320 shutdown_connections 2024-08-17T02:28:38.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.704+0000 7ff87be00640 1 -- 172.21.15.46:0/2955232320 wait complete. 2024-08-17T02:28:38.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.706+0000 7ff87be00640 1 Processor -- start 2024-08-17T02:28:38.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.706+0000 7ff87be00640 1 -- start start 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0ae5b0 0x7ff87c15d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff87c15c7c0 0x7ff87c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c158460 con 0x7ff87c0aefb0 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c1585f0 con 0x7ff87c0ae5b0 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c15d860 con 0x7ff87c15c7c0 2024-08-17T02:28:38.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff873e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff873e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39596/0 (socket says 172.21.15.46:39596) 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff873e00640 1 -- 172.21.15.46:0/6693695 learned_addr learned my addr 172.21.15.46:0/6693695 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87aa00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0ae5b0 0x7ff87c15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.707+0000 7ff87b400640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff87c15c7c0 0x7ff87c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 -- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff87c15c7c0 msgr2=0x7ff87c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff87c15c7c0 0x7ff87c06b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 -- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0ae5b0 msgr2=0x7ff87c15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0ae5b0 0x7ff87c15d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 -- 172.21.15.46:0/6693695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009390 con 0x7ff87c0aefb0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff873e00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c5b0 tx=0x7ff864007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864005aa0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864005c00 con 0x7ff87c0aefb0 2024-08-17T02:28:38.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640070f0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c15db40 con 0x7ff87c0aefb0 2024-08-17T02:28:38.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.708+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c15e100 con 0x7ff87c0aefb0 2024-08-17T02:28:38.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.710+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c1587a0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.710+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff864007520 con 0x7ff87c0aefb0 2024-08-17T02:28:38.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.711+0000 7ff872000640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 0x7ff858067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.711+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff864081de0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.712+0000 7ff87aa00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 0x7ff858067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.712+0000 7ff87aa00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 0x7ff858067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.715+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff87c1587a0 con 0x7ff87c0aefb0 2024-08-17T02:28:38.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:38.926+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000237964", "target": ["mon-mgr", ""]}) v1 -- 0x7ff87c158760 con 0x7ff858065150 2024-08-17T02:28:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.804+0000 7ff872000640 1 -- 172.21.15.46:0/6693695 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7ff87c158760 con 0x7ff858065150 2024-08-17T02:28:41.805 INFO:teuthology.orchestra.run.smithi046.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:28:41.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.812+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 msgr2=0x7ff858067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.812+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 0x7ff858067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:41.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.812+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 msgr2=0x7ff87c0b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.812+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c5b0 tx=0x7ff864007d70 comp rx=0 tx=0).stop 2024-08-17T02:28:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 shutdown_connections 2024-08-17T02:28:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff858065150 0x7ff858067600 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff87c15c7c0 0x7ff87c06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff87c0aefb0 0x7ff87c0b3200 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 --2- 172.21.15.46:0/6693695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff87c0ae5b0 0x7ff87c15d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.813+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 >> 172.21.15.46:0/6693695 conn(0x7ff87c096a70 msgr2=0x7ff87c0ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.816+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 shutdown_connections 2024-08-17T02:28:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.816+0000 7ff87be00640 1 -- 172.21.15.46:0/6693695 wait complete. 2024-08-17T02:28:41.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:41.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.995+0000 7feaa5e00640 1 Processor -- start 2024-08-17T02:28:41.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.995+0000 7feaa5e00640 1 -- start start 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feaa00b0270 0x7feaa01563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa0157690 con 0x7feaa0158b30 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa0156a80 con 0x7feaa0155900 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa0156d60 con 0x7feaa00b0270 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7feaa0158b30 0x7feaa00ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54310/0 (socket says 172.21.15.46:54310) 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7feaa5400640 1 -- 172.21.15.46:0/3914085232 learned_addr learned my addr 172.21.15.46:0/3914085232 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:41.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.997+0000 7fea9fe00640 1 --2- 172.21.15.46:0/3914085232 >> v2:172.21.15.162:3300/0 conn(0x7feaa00b0270 0x7feaa01563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734731092 0 0) 0x7feaa0157690 con 0x7feaa0158b30 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea880034e0 con 0x7feaa0158b30 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210927069 0 0) 0x7feaa0156a80 con 0x7feaa0155900 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaa0157690 con 0x7feaa0155900 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9fe00640 1 -- 172.21.15.46:0/3914085232 >> v1:172.21.15.162:6789/0 conn(0x7feaa0155900 legacy=0x7feaa0155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9fe00640 1 -- 172.21.15.46:0/3914085232 >> v1:172.21.15.46:6789/0 conn(0x7feaa0158b30 legacy=0x7feaa00ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.998+0000 7fea9fe00640 1 -- 172.21.15.46:0/3914085232 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0157040 con 0x7feaa00b0270 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.999+0000 7fea9fe00640 1 --2- 172.21.15.46:0/3914085232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa00b0270 0x7feaa01563e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009850 tx=0x7fea8c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=998944031f7ddc8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.999+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c02ae20 con 0x7feaa00b0270 2024-08-17T02:28:42.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.999+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c032440 con 0x7feaa00b0270 2024-08-17T02:28:42.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:41.999+0000 7fea9f400640 1 -- 172.21.15.46:0/3914085232 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0327c0 con 0x7feaa00b0270 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 -- 172.21.15.46:0/3914085232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa00b0270 msgr2=0x7feaa01563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3914085232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa00b0270 0x7feaa01563e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009850 tx=0x7fea8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 -- 172.21.15.46:0/3914085232 shutdown_connections 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3914085232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa00b0270 0x7feaa01563e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 -- 172.21.15.46:0/3914085232 >> 172.21.15.46:0/3914085232 conn(0x7feaa0067750 msgr2=0x7feaa00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 -- 172.21.15.46:0/3914085232 shutdown_connections 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.000+0000 7feaa5e00640 1 -- 172.21.15.46:0/3914085232 wait complete. 2024-08-17T02:28:42.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.001+0000 7feaa5e00640 1 Processor -- start 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.001+0000 7feaa5e00640 1 -- start start 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 0x7feaa01462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa0158b30 0x7feaa00aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0149dd0 con 0x7feaa0155900 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0168ef0 con 0x7feaa0158b30 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7feaa5e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01467f0 con 0x7feaa00b0270 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.002+0000 7fea9fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55332/0 (socket says 172.21.15.46:55332) 2024-08-17T02:28:42.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 -- 172.21.15.46:0/3772951637 learned_addr learned my addr 172.21.15.46:0/3772951637 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7feaa5400640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa0158b30 0x7feaa00aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7feaa4a00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 0x7feaa01462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 -- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 msgr2=0x7feaa01462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 0x7feaa01462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 -- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa0158b30 msgr2=0x7feaa00aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa0158b30 0x7feaa00aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 -- 172.21.15.46:0/3772951637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009390 con 0x7feaa0155900 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7feaa4a00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 0x7feaa01462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:42.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.003+0000 7fea9fe00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009130 tx=0x7fea8c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.004+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0316b0 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.004+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c031810 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.004+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c031bd0 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.004+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa0149af0 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.004+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa0169450 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.005+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa0071050 con 0x7feaa0155900 2024-08-17T02:28:42.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.006+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea8c03c400 con 0x7feaa0155900 2024-08-17T02:28:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.006+0000 7fea93e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 0x7fea80067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.007+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fea8c0a27b0 con 0x7feaa0155900 2024-08-17T02:28:42.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.007+0000 7feaa4a00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 0x7fea80067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.007+0000 7feaa4a00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 0x7fea80067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea94000c00 tx=0x7fea94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.011+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea8c070500 con 0x7feaa0155900 2024-08-17T02:28:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.218+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa006f480 con 0x7fea80065180 2024-08-17T02:28:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.220+0000 7fea93e00640 1 -- 172.21.15.46:0/3772951637 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7feaa006f480 con 0x7fea80065180 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephfs" 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volume_0000000000237964" 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-08-17T02:28:42.221 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 msgr2=0x7fea80067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 0x7fea80067630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fea94000c00 tx=0x7fea94009040 comp rx=0 tx=0).stop 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 msgr2=0x7feaa01490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009130 tx=0x7fea8c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 shutdown_connections 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa0158b30 0x7feaa00aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaa0155900 0x7feaa01490a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fea80065180 0x7fea80067630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 --2- 172.21.15.46:0/3772951637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa00b0270 0x7feaa01462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 >> 172.21.15.46:0/3772951637 conn(0x7feaa0067750 msgr2=0x7feaa00ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 shutdown_connections 2024-08-17T02:28:42.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.222+0000 7feaa5e00640 1 -- 172.21.15.46:0/3772951637 wait complete. 2024-08-17T02:28:42.237 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:28:42.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.389+0000 7fadd7000640 1 Processor -- start 2024-08-17T02:28:42.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.390+0000 7fadd7000640 1 -- start start 2024-08-17T02:28:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadd0156a40 0x7fadd0156e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 0x7fadd006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 0x7fadd006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd00ca900 con 0x7fadd0156a40 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd006e430 con 0x7fadd006dab0 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd7000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd006e6d0 con 0x7fadd00cbea0 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd5c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadd0156a40 0x7fadd0156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd5c00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fadd0156a40 0x7fadd0156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55336/0 (socket says 172.21.15.46:55336) 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.391+0000 7fadd5c00640 1 -- 172.21.15.46:0/2097375711 learned_addr learned my addr 172.21.15.46:0/2097375711 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd6600640 1 --2- 172.21.15.46:0/2097375711 >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 0x7fadd006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5c00640 1 -- 172.21.15.46:0/2097375711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 msgr2=0x7fadd006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5200640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 0x7fadd006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5c00640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 0x7fadd006d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5c00640 1 -- 172.21.15.46:0/2097375711 >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 msgr2=0x7fadd006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:42.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5c00640 1 --2- 172.21.15.46:0/2097375711 >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 0x7fadd006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5c00640 1 -- 172.21.15.46:0/2097375711 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00caba0 con 0x7fadd0156a40 2024-08-17T02:28:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd6600640 1 --2- 172.21.15.46:0/2097375711 >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 0x7fadd006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:42.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.392+0000 7fadd5200640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 0x7fadd006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.393+0000 7fadd5c00640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd0156e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fadd006e600 tx=0x7fadc40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516dc91437a2b5e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.393+0000 7fadcfe00640 1 -- 172.21.15.46:0/2097375711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc402ac90 con 0x7fadd0156a40 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.393+0000 7fadcfe00640 1 -- 172.21.15.46:0/2097375711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc402adf0 con 0x7fadd0156a40 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.393+0000 7fadcfe00640 1 -- 172.21.15.46:0/2097375711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4032670 con 0x7fadd0156a40 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 -- 172.21.15.46:0/2097375711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 msgr2=0x7fadd0156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd0156e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fadd006e600 tx=0x7fadc40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 -- 172.21.15.46:0/2097375711 shutdown_connections 2024-08-17T02:28:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 --2- 172.21.15.46:0/2097375711 >> v2:172.21.15.162:3300/0 conn(0x7fadd006dab0 0x7fadd006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd00cbea0 0x7fadd006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 --2- 172.21.15.46:0/2097375711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd0156e10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 -- 172.21.15.46:0/2097375711 >> 172.21.15.46:0/2097375711 conn(0x7fadd0067750 msgr2=0x7fadd00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 -- 172.21.15.46:0/2097375711 shutdown_connections 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.394+0000 7fadd7000640 1 -- 172.21.15.46:0/2097375711 wait complete. 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.395+0000 7fadd7000640 1 Processor -- start 2024-08-17T02:28:42.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.395+0000 7fadd7000640 1 -- start start 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd006dab0 0x7fadd014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd00cbea0 0x7fadd014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0166e90 con 0x7fadd0156a40 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd0167cb0 con 0x7fadd00cbea0 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd7000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd01670a0 con 0x7fadd006dab0 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.396+0000 7fadd6600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55338/0 (socket says 172.21.15.46:55338) 2024-08-17T02:28:42.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 -- 172.21.15.46:0/683197612 learned_addr learned my addr 172.21.15.46:0/683197612 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd5200640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd00cbea0 0x7fadd014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd5c00640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd006dab0 0x7fadd014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 -- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd006dab0 msgr2=0x7fadd014b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd006dab0 0x7fadd014b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 -- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd00cbea0 msgr2=0x7fadd014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd00cbea0 0x7fadd014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 -- 172.21.15.46:0/683197612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009450 con 0x7fadd0156a40 2024-08-17T02:28:42.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadd6600640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fadc800cf60 tx=0x7fadc8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.397+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800ae90 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.398+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800d650 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.398+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800da10 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.398+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd0167380 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.398+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd0167940 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.399+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd0071050 con 0x7fadd0156a40 2024-08-17T02:28:42.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.400+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fadc801e3b0 con 0x7fadd0156a40 2024-08-17T02:28:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.400+0000 7fadccc00640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 0x7fadb0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.401+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fadc80830d0 con 0x7fadd0156a40 2024-08-17T02:28:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.401+0000 7fadd5c00640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 0x7fadb0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.402+0000 7fadd5c00640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 0x7fadb0067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadc4034000 tx=0x7fadc4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.404+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fadc8050ec0 con 0x7fadd0156a40 2024-08-17T02:28:42.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.587+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fadd006f480 con 0x7fadd0156a40 2024-08-17T02:28:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.588+0000 7fadccc00640 1 -- 172.21.15.46:0/683197612 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fadc80544e0 con 0x7fadd0156a40 2024-08-17T02:28:42.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 msgr2=0x7fadb0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 0x7fadb0067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fadc4034000 tx=0x7fadc4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 msgr2=0x7fadd01581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fadc800cf60 tx=0x7fadc8007870 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 shutdown_connections 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadd0156a40 0x7fadd01581b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadd00cbea0 0x7fadd014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fadb0065150 0x7fadb0067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 --2- 172.21.15.46:0/683197612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadd006dab0 0x7fadd014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 >> 172.21.15.46:0/683197612 conn(0x7fadd0067750 msgr2=0x7fadd0068760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.590+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 shutdown_connections 2024-08-17T02:28:42.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.591+0000 7fadd7000640 1 -- 172.21.15.46:0/683197612 wait complete. 2024-08-17T02:28:42.606 INFO:teuthology.orchestra.run.smithi046.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}] 2024-08-17T02:28:42.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000237964 --format=json 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.759+0000 7f3df3200640 1 Processor -- start 2024-08-17T02:28:42.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.759+0000 7f3df3200640 1 -- start start 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df3200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3df4155900 0x7f3df4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df3200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df4157690 con 0x7f3df4158b30 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df4156a80 con 0x7f3df40b0270 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df3200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df4156d60 con 0x7f3df4155900 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3df4155900 0x7f3df4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df1e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3df4155900 0x7f3df4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55342/0 (socket says 172.21.15.46:55342) 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df1e00640 1 -- 172.21.15.46:0/7504050 learned_addr learned my addr 172.21.15.46:0/7504050 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.760+0000 7f3df2800640 1 --1- 172.21.15.46:0/7504050 >> v1:172.21.15.46:6789/0 conn(0x7f3df4158b30 0x7f3df40ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54318/0 (socket says 172.21.15.46:54318) 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.761+0000 7f3df1e00640 1 -- 172.21.15.46:0/7504050 >> v1:172.21.15.162:6789/0 conn(0x7f3df40b0270 legacy=0x7f3df4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.761+0000 7f3df1e00640 1 -- 172.21.15.46:0/7504050 >> v1:172.21.15.46:6789/0 conn(0x7f3df4158b30 legacy=0x7f3df40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.761+0000 7f3df1e00640 1 -- 172.21.15.46:0/7504050 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4157040 con 0x7f3df4155900 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.761+0000 7f3df1400640 1 -- 172.21.15.46:0/7504050 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218630921 0 0) 0x7f3df4157690 con 0x7f3df4158b30 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.762+0000 7f3df1e00640 1 --2- 172.21.15.46:0/7504050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df4155cd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009910 tx=0x7f3de40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3b157a23150852 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.762+0000 7f3df1400640 1 -- 172.21.15.46:0/7504050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4032440 con 0x7f3df4155900 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.762+0000 7f3df1400640 1 -- 172.21.15.46:0/7504050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de40325a0 con 0x7f3df4155900 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.762+0000 7f3df1400640 1 -- 172.21.15.46:0/7504050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4032940 con 0x7f3df4155900 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 -- 172.21.15.46:0/7504050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 msgr2=0x7f3df4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 --2- 172.21.15.46:0/7504050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df4155cd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009910 tx=0x7f3de40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 -- 172.21.15.46:0/7504050 shutdown_connections 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 --2- 172.21.15.46:0/7504050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df4155cd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 -- 172.21.15.46:0/7504050 >> 172.21.15.46:0/7504050 conn(0x7f3df4067750 msgr2=0x7f3df40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 -- 172.21.15.46:0/7504050 shutdown_connections 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.763+0000 7f3df3200640 1 -- 172.21.15.46:0/7504050 wait complete. 2024-08-17T02:28:42.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.764+0000 7f3df3200640 1 Processor -- start 2024-08-17T02:28:42.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.764+0000 7f3df3200640 1 -- start start 2024-08-17T02:28:42.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 0x7f3df40a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 0x7f3df40a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41655a0 con 0x7f3df4155900 2024-08-17T02:28:42.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40aa970 con 0x7f3df4158b30 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3df3200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4164920 con 0x7f3df40b0270 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3debe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3debe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55354/0 (socket says 172.21.15.46:55354) 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.765+0000 7f3debe00640 1 -- 172.21.15.46:0/730125175 learned_addr learned my addr 172.21.15.46:0/730125175 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df1e00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 0x7f3df40a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 -- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 msgr2=0x7f3df40a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df2800640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 0x7f3df40a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 0x7f3df40a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 -- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 msgr2=0x7f3df40a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 0x7f3df40a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 -- 172.21.15.46:0/730125175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4009450 con 0x7f3df4155900 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df1e00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 0x7f3df40a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df2800640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 0x7f3df40a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3debe00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c560 tx=0x7f3ddc007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011590 con 0x7f3df4155900 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc011710 con 0x7f3df4155900 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011ad0 con 0x7f3df4155900 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df4164c00 con 0x7f3df4155900 2024-08-17T02:28:42.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.766+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df41651c0 con 0x7f3df4155900 2024-08-17T02:28:42.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.767+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4071050 con 0x7f3df4155900 2024-08-17T02:28:42.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.768+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ddc01b3b0 con 0x7f3df4155900 2024-08-17T02:28:42.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.769+0000 7f3de9600640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.769+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3ddc081e10 con 0x7f3df4155900 2024-08-17T02:28:42.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.770+0000 7f3df1e00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.770+0000 7f3df1e00640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 0x7f3dd0067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3de4034000 tx=0x7f3de4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.773+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ddc085030 con 0x7f3df4155900 2024-08-17T02:28:42.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.994+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000237964", "format": "json"} v 0) v1 -- 0x7f3df406f480 con 0x7f3df4155900 2024-08-17T02:28:42.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.995+0000 7f3de9600640 1 -- 172.21.15.46:0/730125175 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000237964", "format": "json"}]=0 v21) v1 ==== 110+0+1844 (secure 0 0 0) 0x7f3ddc017070 con 0x7f3df4155900 2024-08-17T02:28:42.996 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:28:42.996 INFO:teuthology.orchestra.run.smithi046.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 msgr2=0x7f3dd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 0x7f3dd0067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3de4034000 tx=0x7f3de4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 msgr2=0x7f3df40aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c560 tx=0x7f3ddc007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 shutdown_connections 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df4158b30 0x7f3df40a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3df4155900 0x7f3df40aa430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3dd0065150 0x7f3dd0067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 --2- 172.21.15.46:0/730125175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df40b0270 0x7f3df40a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 >> 172.21.15.46:0/730125175 conn(0x7f3df4067750 msgr2=0x7f3df406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 shutdown_connections 2024-08-17T02:28:42.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:42.997+0000 7f3df3200640 1 -- 172.21.15.46:0/730125175 wait complete. 2024-08-17T02:28:43.013 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000237964 --yes-i-really-mean-it 2024-08-17T02:28:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.166+0000 7fd477200640 1 Processor -- start 2024-08-17T02:28:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.167+0000 7fd477200640 1 -- start start 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd477200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd478155a30 0x7fd47806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd477200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4780afc40 con 0x7fd478155660 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd477200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4780af030 con 0x7fd4780adfb0 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd477200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4780af310 con 0x7fd478155a30 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd475e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd478155660 0x7fd4780c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:54326/0 (socket says 172.21.15.46:54326) 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd475e00640 1 -- 172.21.15.46:0/3795437469 learned_addr learned my addr 172.21.15.46:0/3795437469 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:28:43.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.168+0000 7fd476800640 1 --2- 172.21.15.46:0/3795437469 >> v2:172.21.15.46:3300/0 conn(0x7fd478155a30 0x7fd47806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.169+0000 7fd475400640 1 -- 172.21.15.46:0/3795437469 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452058649 0 0) 0x7fd4780afc40 con 0x7fd478155660 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.169+0000 7fd475400640 1 -- 172.21.15.46:0/3795437469 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c0034e0 con 0x7fd478155660 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.169+0000 7fd476800640 1 -- 172.21.15.46:0/3795437469 >> v1:172.21.15.162:6789/0 conn(0x7fd4780adfb0 legacy=0x7fd4780ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.169+0000 7fd476800640 1 -- 172.21.15.46:0/3795437469 >> v1:172.21.15.46:6789/0 conn(0x7fd478155660 legacy=0x7fd4780c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.169+0000 7fd476800640 1 -- 172.21.15.46:0/3795437469 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4780af5f0 con 0x7fd478155a30 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd476800640 1 --2- 172.21.15.46:0/3795437469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155a30 0x7fd47806dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd470009e60 tx=0x7fd470009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d22570c1e915bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd475400640 1 -- 172.21.15.46:0/3795437469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470007550 con 0x7fd478155a30 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd475400640 1 -- 172.21.15.46:0/3795437469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47002d050 con 0x7fd478155a30 2024-08-17T02:28:43.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd475400640 1 -- 172.21.15.46:0/3795437469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700078c0 con 0x7fd478155a30 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd477200640 1 -- 172.21.15.46:0/3795437469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155a30 msgr2=0x7fd47806dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.170+0000 7fd477200640 1 --2- 172.21.15.46:0/3795437469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155a30 0x7fd47806dec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd470009e60 tx=0x7fd470009780 comp rx=0 tx=0).stop 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.171+0000 7fd477200640 1 -- 172.21.15.46:0/3795437469 shutdown_connections 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.171+0000 7fd477200640 1 --2- 172.21.15.46:0/3795437469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155a30 0x7fd47806dec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.171+0000 7fd477200640 1 -- 172.21.15.46:0/3795437469 >> 172.21.15.46:0/3795437469 conn(0x7fd478066cd0 msgr2=0x7fd4780670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.171+0000 7fd477200640 1 -- 172.21.15.46:0/3795437469 shutdown_connections 2024-08-17T02:28:43.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.171+0000 7fd477200640 1 -- 172.21.15.46:0/3795437469 wait complete. 2024-08-17T02:28:43.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.172+0000 7fd477200640 1 Processor -- start 2024-08-17T02:28:43.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.172+0000 7fd477200640 1 -- start start 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4780adfb0 0x7fd4781440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155660 0x7fd4781580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd478155a30 0x7fd47815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815ac10 con 0x7fd478155660 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815a000 con 0x7fd478155a30 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd477200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47815a2e0 con 0x7fd4780adfb0 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd46d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155660 0x7fd4781580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd46d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155660 0x7fd4781580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55374/0 (socket says 172.21.15.46:55374) 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.173+0000 7fd46d400640 1 -- 172.21.15.46:0/3318208594 learned_addr learned my addr 172.21.15.46:0/3318208594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd476800640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd478155a30 0x7fd47815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd475e00640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4780adfb0 0x7fd4781440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 -- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4780adfb0 msgr2=0x7fd4781440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4780adfb0 0x7fd4781440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 -- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd478155a30 msgr2=0x7fd47815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd478155a30 0x7fd47815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 -- 172.21.15.46:0/3318208594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009a20 con 0x7fd478155660 2024-08-17T02:28:43.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46d400640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd478155660 0x7fd4781580a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd46000c590 tx=0x7fd460007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460011590 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460011710 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460011b10 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.174+0000 7fd477200640 1 -- 172.21.15.46:0/3318208594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47815a5c0 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.175+0000 7fd477200640 1 -- 172.21.15.46:0/3318208594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd478159c20 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.176+0000 7fd477200640 1 -- 172.21.15.46:0/3318208594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47815adc0 con 0x7fd478155660 2024-08-17T02:28:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.176+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd46001c460 con 0x7fd478155660 2024-08-17T02:28:43.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.178+0000 7fd46e000640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd454065150 0x7fd454067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.178+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd460082400 con 0x7fd478155660 2024-08-17T02:28:43.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.178+0000 7fd475e00640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd454065150 0x7fd454067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.179+0000 7fd475e00640 1 --2- 172.21.15.46:0/3318208594 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd454065150 0x7fd454067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd468005840 tx=0x7fd468009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.182+0000 7fd46e000640 1 -- 172.21.15.46:0/3318208594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd47815adc0 con 0x7fd478155660 2024-08-17T02:28:43.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:28:43.386+0000 7fd477200640 1 -- 172.21.15.46:0/3318208594 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000237964", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fd478071050 con 0x7fd454065150 2024-08-17T02:28:43.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:43.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:46.606 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-08-17T02:28:46.605+0000 7f63ca200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:13.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:13.806 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:43.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:43.900 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:13.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:13.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:43.084 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:30:43.085 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:30:43.086 DEBUG:teuthology.orchestra.run.smithi046:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:43.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:43.264 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:30:43.264 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:30:43.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:43.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:43.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:30:43.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:43.332 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:30:43.369 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:30:43.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:43.369 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:43.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:30:43.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:43.435 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:30:43.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:43.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.623+0000 7efd79400640 1 Processor -- start 2024-08-17T02:30:43.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.623+0000 7efd79400640 1 -- start start 2024-08-17T02:30:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd79400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efd74156ad0 0x7efd740cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd79400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 0x7efd741577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd79400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd740caaf0 con 0x7efd74156ea0 2024-08-17T02:30:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd79400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740ca900 con 0x7efd74156ad0 2024-08-17T02:30:43.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd79400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd740cc560 con 0x7efd7406dc80 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efd74156ad0 0x7efd740cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efd74156ad0 0x7efd740cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58586/0 (socket says 172.21.15.46:58586) 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 -- 172.21.15.46:0/358546967 learned_addr learned my addr 172.21.15.46:0/358546967 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73400640 1 --1- 172.21.15.46:0/358546967 >> v1:172.21.15.46:6789/0 conn(0x7efd74156ea0 0x7efd7406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56556/0 (socket says 172.21.15.46:56556) 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd78a00640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 0x7efd741577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 -- 172.21.15.46:0/358546967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 msgr2=0x7efd741577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 0x7efd741577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 -- 172.21.15.46:0/358546967 >> v1:172.21.15.46:6789/0 conn(0x7efd74156ea0 legacy=0x7efd7406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd73e00640 1 -- 172.21.15.46:0/358546967 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74157300 con 0x7efd74156ad0 2024-08-17T02:30:43.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.625+0000 7efd78a00640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 0x7efd741577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:43.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.626+0000 7efd73e00640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd740cbea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efd64009940 tx=0x7efd640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56153dcdc0f6e30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd72a00640 1 -- 172.21.15.46:0/358546967 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6402ae40 con 0x7efd74156ad0 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd72a00640 1 -- 172.21.15.46:0/358546967 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64032440 con 0x7efd74156ad0 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd72a00640 1 -- 172.21.15.46:0/358546967 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64032820 con 0x7efd74156ad0 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 -- 172.21.15.46:0/358546967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 msgr2=0x7efd740cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd740cbea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efd64009940 tx=0x7efd640091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 -- 172.21.15.46:0/358546967 shutdown_connections 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd7406dc80 0x7efd741577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 --2- 172.21.15.46:0/358546967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd740cbea0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 -- 172.21.15.46:0/358546967 >> 172.21.15.46:0/358546967 conn(0x7efd74067750 msgr2=0x7efd740cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.627+0000 7efd79400640 1 -- 172.21.15.46:0/358546967 shutdown_connections 2024-08-17T02:30:43.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.628+0000 7efd79400640 1 -- 172.21.15.46:0/358546967 wait complete. 2024-08-17T02:30:43.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.629+0000 7efd79400640 1 Processor -- start 2024-08-17T02:30:43.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.629+0000 7efd79400640 1 -- start start 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7406dc80 0x7efd7414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd74156ea0 0x7efd74069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740c7330 con 0x7efd74156ad0 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740ae8f0 con 0x7efd7406dc80 2024-08-17T02:30:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd79400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd740c75f0 con 0x7efd74156ea0 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd73400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd73400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58598/0 (socket says 172.21.15.46:58598) 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd73400640 1 -- 172.21.15.46:0/4173875932 learned_addr learned my addr 172.21.15.46:0/4173875932 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd73e00640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7406dc80 0x7efd7414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.630+0000 7efd78a00640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd74156ea0 0x7efd74069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 -- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd74156ea0 msgr2=0x7efd74069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd74156ea0 0x7efd74069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 -- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7406dc80 msgr2=0x7efd7414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7406dc80 0x7efd7414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 -- 172.21.15.46:0/4173875932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009450 con 0x7efd74156ad0 2024-08-17T02:30:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd73400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c4b0 tx=0x7efd60007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60007360 con 0x7efd74156ad0 2024-08-17T02:30:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600074c0 con 0x7efd74156ad0 2024-08-17T02:30:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600049f0 con 0x7efd74156ad0 2024-08-17T02:30:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd740c78d0 con 0x7efd74156ad0 2024-08-17T02:30:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.631+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7414d500 con 0x7efd74156ad0 2024-08-17T02:30:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.632+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd74071050 con 0x7efd74156ad0 2024-08-17T02:30:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.633+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efd60014420 con 0x7efd74156ad0 2024-08-17T02:30:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.634+0000 7efd6b400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 0x7efd54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.634+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7efd60082390 con 0x7efd74156ad0 2024-08-17T02:30:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.634+0000 7efd73e00640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 0x7efd54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.635+0000 7efd73e00640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 0x7efd54067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd64034000 tx=0x7efd64032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.638+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efd60050160 con 0x7efd74156ad0 2024-08-17T02:30:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.861+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd7406f480 con 0x7efd74156ad0 2024-08-17T02:30:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.861+0000 7efd6b400640 1 -- 172.21.15.46:0/4173875932 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7efd60053780 con 0x7efd74156ad0 2024-08-17T02:30:43.862 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:43.863 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-08-17T02:30:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.863+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 msgr2=0x7efd54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.863+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 0x7efd54067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efd64034000 tx=0x7efd64032000 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.863+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 msgr2=0x7efd74069940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.863+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c4b0 tx=0x7efd60007eb0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 shutdown_connections 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efd54065150 0x7efd54067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd74156ea0 0x7efd74069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd74156ad0 0x7efd74069940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 --2- 172.21.15.46:0/4173875932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd7406dc80 0x7efd7414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 >> 172.21.15.46:0/4173875932 conn(0x7efd74067750 msgr2=0x7efd74154880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 shutdown_connections 2024-08-17T02:30:43.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:43.864+0000 7efd79400640 1 -- 172.21.15.46:0/4173875932 wait complete. 2024-08-17T02:30:43.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:44.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.030+0000 7fe62b200640 1 Processor -- start 2024-08-17T02:30:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.031+0000 7fe62b200640 1 -- start start 2024-08-17T02:30:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe62b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe62c156ad0 0x7fe62c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe62b200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe62c156ea0 0x7fe62c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe62b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe62c0caaf0 con 0x7fe62c06dab0 2024-08-17T02:30:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe62b200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c0ca900 con 0x7fe62c156ea0 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe62b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62c0cc560 con 0x7fe62c156ad0 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe623e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe62c156ea0 0x7fe62c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe623e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe62c156ea0 0x7fe62c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58604/0 (socket says 172.21.15.46:58604) 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe623e00640 1 -- 172.21.15.46:0/2191971561 learned_addr learned my addr 172.21.15.46:0/2191971561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.032+0000 7fe629e00640 1 --2- 172.21.15.46:0/2191971561 >> v2:172.21.15.162:3300/0 conn(0x7fe62c156ad0 0x7fe62c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.033+0000 7fe623e00640 1 -- 172.21.15.46:0/2191971561 >> v2:172.21.15.162:3300/0 conn(0x7fe62c156ad0 msgr2=0x7fe62c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.033+0000 7fe623e00640 1 --2- 172.21.15.46:0/2191971561 >> v2:172.21.15.162:3300/0 conn(0x7fe62c156ad0 0x7fe62c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.033+0000 7fe623e00640 1 -- 172.21.15.46:0/2191971561 >> v1:172.21.15.162:6789/0 conn(0x7fe62c06dab0 legacy=0x7fe62c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.033+0000 7fe623e00640 1 -- 172.21.15.46:0/2191971561 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c157300 con 0x7fe62c156ea0 2024-08-17T02:30:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.034+0000 7fe623e00640 1 --2- 172.21.15.46:0/2191971561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c06d570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe62c065fd0 tx=0x7fe6140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea69fd57ff7d8ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.034+0000 7fe629400640 1 -- 172.21.15.46:0/2191971561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61402ae60 con 0x7fe62c156ea0 2024-08-17T02:30:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.034+0000 7fe629400640 1 -- 172.21.15.46:0/2191971561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614032440 con 0x7fe62c156ea0 2024-08-17T02:30:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.034+0000 7fe629400640 1 -- 172.21.15.46:0/2191971561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140327e0 con 0x7fe62c156ea0 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 -- 172.21.15.46:0/2191971561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 msgr2=0x7fe62c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 --2- 172.21.15.46:0/2191971561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c06d570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe62c065fd0 tx=0x7fe6140091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 -- 172.21.15.46:0/2191971561 shutdown_connections 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 --2- 172.21.15.46:0/2191971561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c06d570 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 --2- 172.21.15.46:0/2191971561 >> v2:172.21.15.162:3300/0 conn(0x7fe62c156ad0 0x7fe62c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 -- 172.21.15.46:0/2191971561 >> 172.21.15.46:0/2191971561 conn(0x7fe62c067750 msgr2=0x7fe62c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 -- 172.21.15.46:0/2191971561 shutdown_connections 2024-08-17T02:30:44.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.035+0000 7fe62b200640 1 -- 172.21.15.46:0/2191971561 wait complete. 2024-08-17T02:30:44.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.037+0000 7fe62b200640 1 Processor -- start 2024-08-17T02:30:44.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.037+0000 7fe62b200640 1 -- start start 2024-08-17T02:30:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe62c06dab0 0x7fe62c15a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe62c156ad0 0x7fe62c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c52d0 con 0x7fe62c156ea0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c14ae30 con 0x7fe62c06dab0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c0c5fd0 con 0x7fe62c156ad0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe629e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe62c06dab0 0x7fe62c15a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe623e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe62c156ad0 0x7fe62c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58610/0 (socket says 172.21.15.46:58610) 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 -- 172.21.15.46:0/553353057 learned_addr learned my addr 172.21.15.46:0/553353057 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 -- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe62c156ad0 msgr2=0x7fe62c15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe62c156ad0 0x7fe62c15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 -- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe62c06dab0 msgr2=0x7fe62c15a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe62c06dab0 0x7fe62c15a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.038+0000 7fe62a800640 1 -- 172.21.15.46:0/553353057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009450 con 0x7fe62c156ea0 2024-08-17T02:30:44.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe62a800640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c890 tx=0x7fe624001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62400ce80 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62400a850 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c0c5b40 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62400abf0 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.039+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c15e410 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.040+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c0c5cd0 con 0x7fe62c156ea0 2024-08-17T02:30:44.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.041+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe624012420 con 0x7fe62c156ea0 2024-08-17T02:30:44.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.042+0000 7fe621600640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 0x7fe608067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.042+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe6240829e0 con 0x7fe62c156ea0 2024-08-17T02:30:44.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.042+0000 7fe629e00640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 0x7fe608067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.043+0000 7fe629e00640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 0x7fe608067630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d20 tx=0x7fe61c0090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.046+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe624050730 con 0x7fe62c156ea0 2024-08-17T02:30:44.096 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:44.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:44.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.233+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe62c071050 con 0x7fe62c156ea0 2024-08-17T02:30:44.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.234+0000 7fe621600640 1 -- 172.21.15.46:0/553353057 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18599 (secure 0 0 0) 0x7fe624053d50 con 0x7fe62c156ea0 2024-08-17T02:30:44.235 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:44.236 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:42.785711+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.236+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 msgr2=0x7fe608067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.236+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 0x7fe608067630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009d20 tx=0x7fe61c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 msgr2=0x7fe62c15ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c890 tx=0x7fe624001690 comp rx=0 tx=0).stop 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 shutdown_connections 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe62c156ea0 0x7fe62c15ec10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe608065180 0x7fe608067630 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe62c156ad0 0x7fe62c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 --2- 172.21.15.46:0/553353057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe62c06dab0 0x7fe62c15a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 >> 172.21.15.46:0/553353057 conn(0x7fe62c067750 msgr2=0x7fe62c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 shutdown_connections 2024-08-17T02:30:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.237+0000 7fe62b200640 1 -- 172.21.15.46:0/553353057 wait complete. 2024-08-17T02:30:44.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:28:26.218610+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:28:27.110150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000237964.meta', 'create_time': '2024-08-17T02:28:38.969348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000237964'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000237964.data', 'create_time': '2024-08-17T02:28:39.821358+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000237964'}}}] 2024-08-17T02:30:44.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.408+0000 7f97b9a00640 1 Processor -- start 2024-08-17T02:30:44.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.408+0000 7f97b9a00640 1 -- start start 2024-08-17T02:30:44.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.409+0000 7f97b9a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 0x7f97b40ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.409+0000 7f97b9a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b40cc5f0 0x7f97b40acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.409+0000 7f97b9a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b40ac390 con 0x7f97b4158b90 2024-08-17T02:30:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.409+0000 7f97b9a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40ab4a0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.409+0000 7f97b9a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b40ab780 con 0x7f97b4158f60 2024-08-17T02:30:44.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b40cc5f0 0x7f97b40acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f97b40cc5f0 0x7f97b40acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58622/0 (socket says 172.21.15.46:58622) 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 -- 172.21.15.46:0/1597671012 learned_addr learned my addr 172.21.15.46:0/1597671012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97abe00640 1 --2- 172.21.15.46:0/1597671012 >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 0x7f97b40ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 -- 172.21.15.46:0/1597671012 >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 msgr2=0x7f97b40ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 --2- 172.21.15.46:0/1597671012 >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 0x7f97b40ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 -- 172.21.15.46:0/1597671012 >> v1:172.21.15.162:6789/0 conn(0x7f97b4158b90 legacy=0x7f97b40aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97b3400640 1 -- 172.21.15.46:0/1597671012 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b40aba60 con 0x7f97b40cc5f0 2024-08-17T02:30:44.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.410+0000 7f97abe00640 1 --2- 172.21.15.46:0/1597671012 >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 0x7f97b40ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.411+0000 7f97b3400640 1 --2- 172.21.15.46:0/1597671012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b40acd60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f97b406bba0 tx=0x7f97ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f83828267e6881 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.411+0000 7f97b2000640 1 -- 172.21.15.46:0/1597671012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac02e050 con 0x7f97b40cc5f0 2024-08-17T02:30:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.411+0000 7f97b2000640 1 -- 172.21.15.46:0/1597671012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac007400 con 0x7f97b40cc5f0 2024-08-17T02:30:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.411+0000 7f97b2000640 1 -- 172.21.15.46:0/1597671012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac0077e0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 -- 172.21.15.46:0/1597671012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 msgr2=0x7f97b40acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 --2- 172.21.15.46:0/1597671012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b40acd60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f97b406bba0 tx=0x7f97ac009840 comp rx=0 tx=0).stop 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 -- 172.21.15.46:0/1597671012 shutdown_connections 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 --2- 172.21.15.46:0/1597671012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b40acd60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 --2- 172.21.15.46:0/1597671012 >> v2:172.21.15.162:3300/0 conn(0x7f97b4158f60 0x7f97b40ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 -- 172.21.15.46:0/1597671012 >> 172.21.15.46:0/1597671012 conn(0x7f97b4067750 msgr2=0x7f97b40cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 -- 172.21.15.46:0/1597671012 shutdown_connections 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.412+0000 7f97b9a00640 1 -- 172.21.15.46:0/1597671012 wait complete. 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.413+0000 7f97b9a00640 1 Processor -- start 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 -- start start 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 0x7f97b414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 0x7f97b4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b4150560 con 0x7f97b40cc5f0 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b414f950 con 0x7f97b4158f60 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.414+0000 7f97b9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b414fc30 con 0x7f97b4158b90 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58628/0 (socket says 172.21.15.46:58628) 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 -- 172.21.15.46:0/2733132845 learned_addr learned my addr 172.21.15.46:0/2733132845 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b3400640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 0x7f97b4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 -- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 msgr2=0x7f97b414ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97abe00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 0x7f97b414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 0x7f97b414ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 -- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 msgr2=0x7f97b4159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 0x7f97b4159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 -- 172.21.15.46:0/2733132845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac009ae0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b3400640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 0x7f97b4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97abe00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 0x7f97b414ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.415+0000 7f97b2a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c560 tx=0x7f97a4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.416+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4011590 con 0x7f97b40cc5f0 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.416+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a4011710 con 0x7f97b40cc5f0 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.416+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b414ff10 con 0x7f97b40cc5f0 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.416+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4011ad0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.416+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b414d9c0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.417+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b4064db0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.418+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f97a401b3b0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.418+0000 7f97aa000640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 0x7f9790067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.418+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f97a4081de0 con 0x7f97b40cc5f0 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.419+0000 7f97abe00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 0x7f9790067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.419+0000 7f97abe00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 0x7f9790067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.422+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f97a404fa80 con 0x7f97b40cc5f0 2024-08-17T02:30:44.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.604+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97b406d280 con 0x7f97b40cc5f0 2024-08-17T02:30:44.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.605+0000 7f97aa000640 1 -- 172.21.15.46:0/2733132845 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97a4017070 con 0x7f97b40cc5f0 2024-08-17T02:30:44.606 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 msgr2=0x7f9790067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 0x7f9790067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 msgr2=0x7f97b414d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c560 tx=0x7f97a4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 shutdown_connections 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b4158f60 0x7f97b4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9790065150 0x7f9790067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97b4158b90 0x7f97b414ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 --2- 172.21.15.46:0/2733132845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b40cc5f0 0x7f97b414d480 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 >> 172.21.15.46:0/2733132845 conn(0x7f97b4067750 msgr2=0x7f97b40687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 shutdown_connections 2024-08-17T02:30:44.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.607+0000 7f97b9a00640 1 -- 172.21.15.46:0/2733132845 wait complete. 2024-08-17T02:30:44.622 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:30:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.778+0000 7f211fc00640 1 Processor -- start 2024-08-17T02:30:44.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.778+0000 7f211fc00640 1 -- start start 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f211fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 0x7f21180af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f211fc00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180c6b90 con 0x7f211815c930 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f211fc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211815cdd0 con 0x7f21180c5d50 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f211fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211815d950 con 0x7f21180aee00 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f2117e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f211815c930 0x7f2118159d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56570/0 (socket says 172.21.15.46:56570) 2024-08-17T02:30:44.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.779+0000 7f2117e00640 1 -- 172.21.15.46:0/2614676099 learned_addr learned my addr 172.21.15.46:0/2614676099 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f211d200640 1 --2- 172.21.15.46:0/2614676099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 0x7f21180af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014587867 0 0) 0x7f21180c6b90 con 0x7f211815c930 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21000034e0 con 0x7f211815c930 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523555013 0 0) 0x7f211815cdd0 con 0x7f21180c5d50 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f211d200640 1 -- 172.21.15.46:0/2614676099 >> v1:172.21.15.162:6789/0 conn(0x7f21180c5d50 legacy=0x7f21180c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f211d200640 1 -- 172.21.15.46:0/2614676099 >> v1:172.21.15.46:6789/0 conn(0x7f211815c930 legacy=0x7f2118159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.780+0000 7f211d200640 1 -- 172.21.15.46:0/2614676099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211815d0b0 con 0x7f21180aee00 2024-08-17T02:30:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.781+0000 7f211d200640 1 --2- 172.21.15.46:0/2614676099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 0x7f21180af1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f210c009880 tx=0x7f210c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cf8687edd488743 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.781+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c02ae10 con 0x7f21180aee00 2024-08-17T02:30:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.781+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c032440 con 0x7f21180aee00 2024-08-17T02:30:44.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.781+0000 7f2117400640 1 -- 172.21.15.46:0/2614676099 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0327e0 con 0x7f21180aee00 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 -- 172.21.15.46:0/2614676099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 msgr2=0x7f21180af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 --2- 172.21.15.46:0/2614676099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 0x7f21180af1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f210c009880 tx=0x7f210c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 -- 172.21.15.46:0/2614676099 shutdown_connections 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 --2- 172.21.15.46:0/2614676099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21180aee00 0x7f21180af1d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 -- 172.21.15.46:0/2614676099 >> 172.21.15.46:0/2614676099 conn(0x7f21180cd4b0 msgr2=0x7f21180c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 -- 172.21.15.46:0/2614676099 shutdown_connections 2024-08-17T02:30:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.782+0000 7f211fc00640 1 -- 172.21.15.46:0/2614676099 wait complete. 2024-08-17T02:30:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.783+0000 7f211fc00640 1 Processor -- start 2024-08-17T02:30:44.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 -- start start 2024-08-17T02:30:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21180aee00 0x7f2118169460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f211815c930 0x7f21180a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211815a840 con 0x7f21180c5d50 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211815ab20 con 0x7f21180aee00 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.784+0000 7f211fc00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211815ae00 con 0x7f211815c930 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58644/0 (socket says 172.21.15.46:58644) 2024-08-17T02:30:44.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 -- 172.21.15.46:0/3526325112 learned_addr learned my addr 172.21.15.46:0/3526325112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f211dc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f211815c930 0x7f21180a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f211d200640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21180aee00 0x7f2118169460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 -- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f211815c930 msgr2=0x7f21180a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f211815c930 0x7f21180a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 -- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21180aee00 msgr2=0x7f2118169460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21180aee00 0x7f2118169460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.785+0000 7f2117e00640 1 -- 172.21.15.46:0/3526325112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c009390 con 0x7f21180c5d50 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f2117e00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f210400c4c0 tx=0x7f2104007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104005aa0 con 0x7f21180c5d50 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2104005c00 con 0x7f21180c5d50 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211815b0e0 con 0x7f21180c5d50 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040070d0 con 0x7f21180c5d50 2024-08-17T02:30:44.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.786+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211814a890 con 0x7f21180c5d50 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.787+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118071050 con 0x7f21180c5d50 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.788+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2104007480 con 0x7f21180c5d50 2024-08-17T02:30:44.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.789+0000 7f210be00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 0x7f20f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.789+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2104081cc0 con 0x7f21180c5d50 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.789+0000 7f211d200640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 0x7f20f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:44.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.790+0000 7f211d200640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 0x7f20f8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f210c034000 tx=0x7f210c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:44.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.792+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2104088080 con 0x7f21180c5d50 2024-08-17T02:30:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.977+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2118070210 con 0x7f21180c5d50 2024-08-17T02:30:44.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.977+0000 7f210be00640 1 -- 172.21.15.46:0/3526325112 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21040170a0 con 0x7f21180c5d50 2024-08-17T02:30:44.978 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:30:44.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 msgr2=0x7f20f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 0x7f20f8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f210c034000 tx=0x7f210c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 msgr2=0x7f211814a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f210400c4c0 tx=0x7f2104007d00 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 shutdown_connections 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f20f8065150 0x7f20f8067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f211815c930 0x7f21180a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21180c5d50 0x7f211814a350 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 --2- 172.21.15.46:0/3526325112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21180aee00 0x7f2118169460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 >> 172.21.15.46:0/3526325112 conn(0x7f21180cd4b0 msgr2=0x7f21181569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 shutdown_connections 2024-08-17T02:30:44.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:44.980+0000 7f211fc00640 1 -- 172.21.15.46:0/3526325112 wait complete. 2024-08-17T02:30:44.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:30:45.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.149+0000 7f9be5800640 1 Processor -- start 2024-08-17T02:30:45.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.149+0000 7f9be5800640 1 -- start start 2024-08-17T02:30:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9be5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9be0155090 0x7f9be00abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9be5800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9be0155460 0x7f9be00ad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9be5800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be0156870 con 0x7f9be00adaa0 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9be5800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0155c60 con 0x7f9be0155460 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9be5800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0155f40 con 0x7f9be0155090 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9be0155460 0x7f9be00ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9be0155460 0x7f9be00ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58660/0 (socket says 172.21.15.46:58660) 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 -- 172.21.15.46:0/626228662 learned_addr learned my addr 172.21.15.46:0/626228662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bdfe00640 1 --2- 172.21.15.46:0/626228662 >> v2:172.21.15.162:3300/0 conn(0x7f9be0155090 0x7f9be00abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 -- 172.21.15.46:0/626228662 >> v2:172.21.15.162:3300/0 conn(0x7f9be0155090 msgr2=0x7f9be00abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 --2- 172.21.15.46:0/626228662 >> v2:172.21.15.162:3300/0 conn(0x7f9be0155090 0x7f9be00abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 -- 172.21.15.46:0/626228662 >> v1:172.21.15.162:6789/0 conn(0x7f9be00adaa0 legacy=0x7f9be006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.151+0000 7f9bd7e00640 1 -- 172.21.15.46:0/626228662 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0156220 con 0x7f9be0155460 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.152+0000 7f9bd7e00640 1 --2- 172.21.15.46:0/626228662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00ad560 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9be006a5b0 tx=0x7f9bc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bd4410ce8e2c11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9bdf400640 1 -- 172.21.15.46:0/626228662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc802ae70 con 0x7f9be0155460 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9bdf400640 1 -- 172.21.15.46:0/626228662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8032440 con 0x7f9be0155460 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9bdf400640 1 -- 172.21.15.46:0/626228662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8032820 con 0x7f9be0155460 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 -- 172.21.15.46:0/626228662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 msgr2=0x7f9be00ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 --2- 172.21.15.46:0/626228662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00ad560 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9be006a5b0 tx=0x7f9bc80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 -- 172.21.15.46:0/626228662 shutdown_connections 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 --2- 172.21.15.46:0/626228662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00ad560 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 --2- 172.21.15.46:0/626228662 >> v2:172.21.15.162:3300/0 conn(0x7f9be0155090 0x7f9be00abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 -- 172.21.15.46:0/626228662 >> 172.21.15.46:0/626228662 conn(0x7f9be0066cd0 msgr2=0x7f9be00670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 -- 172.21.15.46:0/626228662 shutdown_connections 2024-08-17T02:30:45.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.153+0000 7f9be5800640 1 -- 172.21.15.46:0/626228662 wait complete. 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.155+0000 7f9be5800640 1 Processor -- start 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.155+0000 7f9be5800640 1 -- start start 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 0x7f9be0146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 0x7f9be0146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00c2150 con 0x7f9be0155460 2024-08-17T02:30:45.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00c1540 con 0x7f9be00adaa0 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be5800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00c1820 con 0x7f9be0155090 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be4e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58676/0 (socket says 172.21.15.46:58676) 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9be4e00640 1 -- 172.21.15.46:0/3829645713 learned_addr learned my addr 172.21.15.46:0/3829645713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9bd7e00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 0x7f9be0146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.156+0000 7f9bdfe00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 0x7f9be0146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 -- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 msgr2=0x7f9be0146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 0x7f9be0146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 -- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 msgr2=0x7f9be0146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 0x7f9be0146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 -- 172.21.15.46:0/3829645713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009450 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9bd7e00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 0x7f9be0146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9bdfe00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 0x7f9be0146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be4e00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c860 tx=0x7f9bd8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800ce50 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800a850 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800ac10 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be00c1b00 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.157+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be016c460 con 0x7f9be0155460 2024-08-17T02:30:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.159+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be00c22c0 con 0x7f9be0155460 2024-08-17T02:30:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.159+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9bd8012630 con 0x7f9be0155460 2024-08-17T02:30:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.160+0000 7f9bd7400640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.160+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9bd80829f0 con 0x7f9be0155460 2024-08-17T02:30:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.161+0000 7f9bdfe00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.162+0000 7f9bdfe00640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 0x7f9bbc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9be016a300 tx=0x7f9bd00090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.164+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9bd8050740 con 0x7f9be0155460 2024-08-17T02:30:45.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.346+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9be0071050 con 0x7f9be0155460 2024-08-17T02:30:45.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.347+0000 7f9bd7400640 1 -- 172.21.15.46:0/3829645713 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bd8053d60 con 0x7f9be0155460 2024-08-17T02:30:45.348 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 msgr2=0x7f9bbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 0x7f9bbc067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9be016a300 tx=0x7f9bd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 msgr2=0x7f9be00c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c860 tx=0x7f9bd8001690 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 shutdown_connections 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9be0155460 0x7f9be00c60c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0155090 0x7f9be0146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.349+0000 7f9be5800640 1 --2- 172.21.15.46:0/3829645713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9be00adaa0 0x7f9be0146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.350+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 >> 172.21.15.46:0/3829645713 conn(0x7f9be0066cd0 msgr2=0x7f9be006d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.350+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 shutdown_connections 2024-08-17T02:30:45.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.350+0000 7f9be5800640 1 -- 172.21.15.46:0/3829645713 wait complete. 2024-08-17T02:30:45.365 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000237964.meta pg_num 2024-08-17T02:30:45.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.519+0000 7f8f31a00640 1 Processor -- start 2024-08-17T02:30:45.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.519+0000 7f8f31a00640 1 -- start start 2024-08-17T02:30:45.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f31a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0ae540 0x7f8f2c0ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f31a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af0f0 0x7f8f2c067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f31a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0ab790 con 0x7f8f2c0af520 2024-08-17T02:30:45.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f31a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0aee50 con 0x7f8f2c0ae540 2024-08-17T02:30:45.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f31a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0aab80 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.520+0000 7f8f2be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0ae540 0x7f8f2c0ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8f2c0ae540 0x7f8f2c0ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58688/0 (socket says 172.21.15.46:58688) 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 -- 172.21.15.46:0/2056230796 learned_addr learned my addr 172.21.15.46:0/2056230796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 -- 172.21.15.46:0/2056230796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af0f0 msgr2=0x7f8f2c067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 --2- 172.21.15.46:0/2056230796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af0f0 0x7f8f2c067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 -- 172.21.15.46:0/2056230796 >> v1:172.21.15.162:6789/0 conn(0x7f8f2c0af520 legacy=0x7f8f2c068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.521+0000 7f8f2be00640 1 -- 172.21.15.46:0/2056230796 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c0aae60 con 0x7f8f2c0ae540 2024-08-17T02:30:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.522+0000 7f8f2be00640 1 --2- 172.21.15.46:0/2056230796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0ae910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009910 tx=0x7f8f1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e454d31f6891a04e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.522+0000 7f8f2b400640 1 -- 172.21.15.46:0/2056230796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c02adb0 con 0x7f8f2c0ae540 2024-08-17T02:30:45.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.522+0000 7f8f2b400640 1 -- 172.21.15.46:0/2056230796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c032440 con 0x7f8f2c0ae540 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.522+0000 7f8f2b400640 1 -- 172.21.15.46:0/2056230796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c032820 con 0x7f8f2c0ae540 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 -- 172.21.15.46:0/2056230796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ae540 msgr2=0x7f8f2c0ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 --2- 172.21.15.46:0/2056230796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0ae910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009910 tx=0x7f8f1c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 -- 172.21.15.46:0/2056230796 shutdown_connections 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 --2- 172.21.15.46:0/2056230796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af0f0 0x7f8f2c067d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 --2- 172.21.15.46:0/2056230796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0ae910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 -- 172.21.15.46:0/2056230796 >> 172.21.15.46:0/2056230796 conn(0x7f8f2c096a70 msgr2=0x7f8f2c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 -- 172.21.15.46:0/2056230796 shutdown_connections 2024-08-17T02:30:45.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.523+0000 7f8f31a00640 1 -- 172.21.15.46:0/2056230796 wait complete. 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.524+0000 7f8f31a00640 1 Processor -- start 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.525+0000 7f8f31a00640 1 -- start start 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.525+0000 7f8f31a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af520 0x7f8f2c146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cce40 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cc230 con 0x7f8f2c0ae540 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cc510 con 0x7f8f2c0af520 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58704/0 (socket says 172.21.15.46:58704) 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 -- 172.21.15.46:0/1208767913 learned_addr learned my addr 172.21.15.46:0/1208767913 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f2be00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f31000640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af520 0x7f8f2c146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 -- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af520 msgr2=0x7f8f2c146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af520 0x7f8f2c146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 -- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f2c0ae540 msgr2=0x7f8f2c0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.526+0000 7f8f23e00640 1 -- 172.21.15.46:0/1208767913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c009450 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f23e00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400b810 tx=0x7f8f140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400be60 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1400c730 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c0cc7f0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400caf0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.527+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c146ac0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.528+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0ccff0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.529+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f14012070 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.530+0000 7f8f23400640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 0x7f8f08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.530+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8f14081eb0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.530+0000 7f8f2be00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 0x7f8f08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.531+0000 7f8f2be00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 0x7f8f08067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c034000 tx=0x7f8f1c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.534+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f2c0ccff0 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.719+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.meta", "var": "pg_num"} v 0) v1 -- 0x7f8f2c071050 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.719+0000 7f8f23400640 1 -- 172.21.15.46:0/1208767913 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.meta", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7f8f1404fb50 con 0x7f8f2c0af0f0 2024-08-17T02:30:45.720 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.721+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 msgr2=0x7f8f08067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.721+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 0x7f8f08067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c034000 tx=0x7f8f1c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.721+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 msgr2=0x7f8f2c09b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.721+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400b810 tx=0x7f8f140091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 shutdown_connections 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8f08065150 0x7f8f08067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2c0af520 0x7f8f2c146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f2c0af0f0 0x7f8f2c09b3c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 --2- 172.21.15.46:0/1208767913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f2c0ae540 0x7f8f2c0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 >> 172.21.15.46:0/1208767913 conn(0x7f8f2c096a70 msgr2=0x7f8f2c0b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 shutdown_connections 2024-08-17T02:30:45.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.722+0000 7f8f31a00640 1 -- 172.21.15.46:0/1208767913 wait complete. 2024-08-17T02:30:45.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000237964.data pg_num 2024-08-17T02:30:45.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.890+0000 7f76be200640 1 Processor -- start 2024-08-17T02:30:45.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.891+0000 7f76be200640 1 -- start start 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76be200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76be200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f76b8155a30 0x7f76b806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76be200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80afc40 con 0x7f76b8155660 2024-08-17T02:30:45.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76be200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b80af030 con 0x7f76b8155a30 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76be200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80af310 con 0x7f76b80adfb0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:36262/0 (socket says 172.21.15.46:36262) 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76b7e00640 1 -- 172.21.15.46:0/1595562517 learned_addr learned my addr 172.21.15.46:0/1595562517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76bce00640 1 --1- 172.21.15.46:0/1595562517 >> v1:172.21.15.162:6789/0 conn(0x7f76b8155660 0x7f76b80c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:40570/0 (socket says 172.21.15.46:40570) 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.892+0000 7f76bd800640 1 --2- 172.21.15.46:0/1595562517 >> v2:172.21.15.162:3300/0 conn(0x7f76b8155a30 0x7f76b806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.893+0000 7f76b7e00640 1 -- 172.21.15.46:0/1595562517 >> v2:172.21.15.162:3300/0 conn(0x7f76b8155a30 msgr2=0x7f76b806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.893+0000 7f76b7e00640 1 --2- 172.21.15.46:0/1595562517 >> v2:172.21.15.162:3300/0 conn(0x7f76b8155a30 0x7f76b806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.893+0000 7f76b7e00640 1 -- 172.21.15.46:0/1595562517 >> v1:172.21.15.162:6789/0 conn(0x7f76b8155660 legacy=0x7f76b80c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.893+0000 7f76b7e00640 1 -- 172.21.15.46:0/1595562517 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80af5f0 con 0x7f76b80adfb0 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76b7e00640 1 --2- 172.21.15.46:0/1595562517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009910 tx=0x7f76a40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb6bcf905876fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76b7400640 1 -- 172.21.15.46:0/1595562517 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a402ae40 con 0x7f76b80adfb0 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76b7400640 1 -- 172.21.15.46:0/1595562517 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4032440 con 0x7f76b80adfb0 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76b7400640 1 -- 172.21.15.46:0/1595562517 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4032820 con 0x7f76b80adfb0 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76be200640 1 -- 172.21.15.46:0/1595562517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 msgr2=0x7f76b80ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.894+0000 7f76be200640 1 --2- 172.21.15.46:0/1595562517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009910 tx=0x7f76a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 -- 172.21.15.46:0/1595562517 shutdown_connections 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 --2- 172.21.15.46:0/1595562517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b80ae750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 --2- 172.21.15.46:0/1595562517 >> v2:172.21.15.162:3300/0 conn(0x7f76b8155a30 0x7f76b806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 -- 172.21.15.46:0/1595562517 >> 172.21.15.46:0/1595562517 conn(0x7f76b8066cd0 msgr2=0x7f76b80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 -- 172.21.15.46:0/1595562517 shutdown_connections 2024-08-17T02:30:45.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.895+0000 7f76be200640 1 -- 172.21.15.46:0/1595562517 wait complete. 2024-08-17T02:30:45.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.896+0000 7f76be200640 1 Processor -- start 2024-08-17T02:30:45.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.896+0000 7f76be200640 1 -- start start 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b8155a30 0x7f76b80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815baf0 con 0x7f76b8155660 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815c4c0 con 0x7f76b8155a30 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76be200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80c81c0 con 0x7f76b80adfb0 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76b7e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58712/0 (socket says 172.21.15.46:58712) 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.897+0000 7f76b7e00640 1 -- 172.21.15.46:0/2542727926 learned_addr learned my addr 172.21.15.46:0/2542727926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76bd800640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b8155a30 0x7f76b80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76bce00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 -- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 msgr2=0x7f76b815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 -- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b8155a30 msgr2=0x7f76b80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b8155a30 0x7f76b80c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 -- 172.21.15.46:0/2542727926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009450 con 0x7f76b8155660 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76bce00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:45.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.898+0000 7f76b7e00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f76a4035040 tx=0x7f76a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.899+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4031900 con 0x7f76b8155660 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.899+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4031a80 con 0x7f76b8155660 2024-08-17T02:30:45.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.899+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4031e80 con 0x7f76b8155660 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.899+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b815aee0 con 0x7f76b8155660 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.899+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b815b4a0 con 0x7f76b8155660 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.900+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b815bc60 con 0x7f76b8155660 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.901+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f76a4043030 con 0x7f76b8155660 2024-08-17T02:30:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.901+0000 7f76abe00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 0x7f7698067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.901+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f76a4041070 con 0x7f76b8155660 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.902+0000 7f76bce00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 0x7f7698067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.903+0000 7f76bce00640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 0x7f7698067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0057b0 tx=0x7f76ac007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:45.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:45.905+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f76a4071050 con 0x7f76b8155660 2024-08-17T02:30:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.092+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.data", "var": "pg_num"} v 0) v1 -- 0x7f76b8071050 con 0x7f76b8155660 2024-08-17T02:30:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.092+0000 7f76abe00640 1 -- 172.21.15.46:0/2542727926 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.data", "var": "pg_num"}]=0 v36) v1 ==== 124+0+11 (secure 0 0 0) 0x7f76a4074670 con 0x7f76b8155660 2024-08-17T02:30:46.093 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 msgr2=0x7f7698067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 0x7f7698067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0057b0 tx=0x7f76ac007d80 comp rx=0 tx=0).stop 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 msgr2=0x7f76b815bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f76a4035040 tx=0x7f76a4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 shutdown_connections 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76b8155a30 0x7f76b80c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76b8155660 0x7f76b815bf80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f7698065150 0x7f7698067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 --2- 172.21.15.46:0/2542727926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76b80adfb0 0x7f76b815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 >> 172.21.15.46:0/2542727926 conn(0x7f76b8066cd0 msgr2=0x7f76b80c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 shutdown_connections 2024-08-17T02:30:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.095+0000 7f76be200640 1 -- 172.21.15.46:0/2542727926 wait complete. 2024-08-17T02:30:46.111 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:46.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.261+0000 7fdb40000640 1 Processor -- start 2024-08-17T02:30:46.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.261+0000 7fdb40000640 1 -- start start 2024-08-17T02:30:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb40000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb380af6d0 0x7fdb380aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb40000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb380afb50 con 0x7fdb380ac820 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb40000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb380abc80 con 0x7fdb38158cb0 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb40000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb380aae50 con 0x7fdb380af6d0 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb380af6d0 0x7fdb380aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb380af6d0 0x7fdb380aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58722/0 (socket says 172.21.15.46:58722) 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 -- 172.21.15.46:0/2922683429 learned_addr learned my addr 172.21.15.46:0/2922683429 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:46.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 -- 172.21.15.46:0/2922683429 >> v1:172.21.15.162:6789/0 conn(0x7fdb38158cb0 legacy=0x7fdb380ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 -- 172.21.15.46:0/2922683429 >> v1:172.21.15.46:6789/0 conn(0x7fdb380ac820 legacy=0x7fdb38159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb3cc00640 1 -- 172.21.15.46:0/2922683429 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380ab070 con 0x7fdb380af6d0 2024-08-17T02:30:46.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.263+0000 7fdb37e00640 1 -- 172.21.15.46:0/2922683429 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863817180 0 0) 0x7fdb30001490 con 0x7fdb380ac820 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.264+0000 7fdb3cc00640 1 --2- 172.21.15.46:0/2922683429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb380af6d0 0x7fdb380aa910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009910 tx=0x7fdb240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6d568574e3c01d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb37e00640 1 -- 172.21.15.46:0/2922683429 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2402ae60 con 0x7fdb380af6d0 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb37e00640 1 -- 172.21.15.46:0/2922683429 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb24032440 con 0x7fdb380af6d0 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb37e00640 1 -- 172.21.15.46:0/2922683429 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb240327e0 con 0x7fdb380af6d0 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 -- 172.21.15.46:0/2922683429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb380af6d0 msgr2=0x7fdb380aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 --2- 172.21.15.46:0/2922683429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb380af6d0 0x7fdb380aa910 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009910 tx=0x7fdb240091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 -- 172.21.15.46:0/2922683429 shutdown_connections 2024-08-17T02:30:46.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 --2- 172.21.15.46:0/2922683429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb380af6d0 0x7fdb380aa910 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 -- 172.21.15.46:0/2922683429 >> 172.21.15.46:0/2922683429 conn(0x7fdb38096a70 msgr2=0x7fdb38096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 -- 172.21.15.46:0/2922683429 shutdown_connections 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.265+0000 7fdb40000640 1 -- 172.21.15.46:0/2922683429 wait complete. 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.267+0000 7fdb40000640 1 Processor -- start 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.267+0000 7fdb40000640 1 -- start start 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb380ac820 0x7fdb38152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb380af6d0 0x7fdb3806be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38159450 con 0x7fdb38158cb0 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3809b370 con 0x7fdb380af6d0 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb40000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb38152d60 con 0x7fdb380ac820 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58728/0 (socket says 172.21.15.46:58728) 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 -- 172.21.15.46:0/4244212923 learned_addr learned my addr 172.21.15.46:0/4244212923 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3cc00640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb380af6d0 0x7fdb3806be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3d600640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb380ac820 0x7fdb38152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 -- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb380ac820 msgr2=0x7fdb38152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb380ac820 0x7fdb38152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 -- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb380af6d0 msgr2=0x7fdb3806be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb380af6d0 0x7fdb3806be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.268+0000 7fdb3e000640 1 -- 172.21.15.46:0/4244212923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009450 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb3e000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c960 tx=0x7fdb30007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000a7f0 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3000a950 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000ad50 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb3809a760 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.269+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3809ad20 con 0x7fdb38158cb0 2024-08-17T02:30:46.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.270+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb3809b4e0 con 0x7fdb38158cb0 2024-08-17T02:30:46.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.271+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdb30012630 con 0x7fdb38158cb0 2024-08-17T02:30:46.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.272+0000 7fdb34c00640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 0x7fdb18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.272+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fdb300829e0 con 0x7fdb38158cb0 2024-08-17T02:30:46.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.272+0000 7fdb3d600640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 0x7fdb18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.273+0000 7fdb3d600640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 0x7fdb18067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b8d0 tx=0x7fdb2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.276+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdb300507d0 con 0x7fdb38158cb0 2024-08-17T02:30:46.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.503+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb380afb50 con 0x7fdb38158cb0 2024-08-17T02:30:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.504+0000 7fdb34c00640 1 -- 172.21.15.46:0/4244212923 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7fdb380afb50 con 0x7fdb38158cb0 2024-08-17T02:30:46.505 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:46.505 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:46.505 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.506+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 msgr2=0x7fdb18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.506+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 0x7fdb18067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b8d0 tx=0x7fdb2c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 msgr2=0x7fdb3806c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c960 tx=0x7fdb30007ed0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 shutdown_connections 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb38158cb0 0x7fdb3806c390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb380af6d0 0x7fdb3806be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb18065150 0x7fdb18067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 --2- 172.21.15.46:0/4244212923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb380ac820 0x7fdb38152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 >> 172.21.15.46:0/4244212923 conn(0x7fdb38096a70 msgr2=0x7fdb38068220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 shutdown_connections 2024-08-17T02:30:46.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.507+0000 7fdb40000640 1 -- 172.21.15.46:0/4244212923 wait complete. 2024-08-17T02:30:46.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:46.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.674+0000 7f8f18c00640 1 Processor -- start 2024-08-17T02:30:46.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.674+0000 7f8f18c00640 1 -- start start 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.675+0000 7f8f18c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f1406df00 0x7f8f140adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.675+0000 7f8f18c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f14155df0 0x7f8f140ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.675+0000 7f8f18c00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f14156670 con 0x7f8f14155a20 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.675+0000 7f8f18c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140b0350 con 0x7f8f1406df00 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.675+0000 7f8f18c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1406e5e0 con 0x7f8f14155df0 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8f14155a20 0x7f8f1406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56598/0 (socket says 172.21.15.46:56598) 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11e00640 1 -- 172.21.15.46:0/4212883245 learned_addr learned my addr 172.21.15.46:0/4212883245 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11400640 1 --2- 172.21.15.46:0/4212883245 >> v2:172.21.15.162:3300/0 conn(0x7f8f1406df00 0x7f8f140adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f12800640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f14155df0 0x7f8f140ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f10a00640 1 -- 172.21.15.46:0/4212883245 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089221127 0 0) 0x7f8f14156670 con 0x7f8f14155a20 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f10a00640 1 -- 172.21.15.46:0/4212883245 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef80034e0 con 0x7f8f14155a20 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11400640 1 -- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f14155df0 msgr2=0x7f8f140ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11400640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f14155df0 0x7f8f140ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11400640 1 -- 172.21.15.46:0/4212883245 >> v1:172.21.15.46:6789/0 conn(0x7f8f14155a20 legacy=0x7f8f1406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.676+0000 7f8f11400640 1 -- 172.21.15.46:0/4212883245 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1406e8c0 con 0x7f8f1406df00 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.677+0000 7f8f11400640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1406df00 0x7f8f140adf10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009850 tx=0x7f8f000090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f4855f90f2366d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.678+0000 7f8f10a00640 1 -- 172.21.15.46:0/4212883245 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0002ad80 con 0x7f8f1406df00 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.678+0000 7f8f10a00640 1 -- 172.21.15.46:0/4212883245 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00032440 con 0x7f8f1406df00 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.678+0000 7f8f10a00640 1 -- 172.21.15.46:0/4212883245 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00032800 con 0x7f8f1406df00 2024-08-17T02:30:46.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.678+0000 7f8f18c00640 1 -- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1406df00 msgr2=0x7f8f140adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.678+0000 7f8f18c00640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1406df00 0x7f8f140adf10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009850 tx=0x7f8f000090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 -- 172.21.15.46:0/4212883245 shutdown_connections 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f14155df0 0x7f8f140ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 --2- 172.21.15.46:0/4212883245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1406df00 0x7f8f140adf10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 -- 172.21.15.46:0/4212883245 >> 172.21.15.46:0/4212883245 conn(0x7f8f140cb9b0 msgr2=0x7f8f140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 -- 172.21.15.46:0/4212883245 shutdown_connections 2024-08-17T02:30:46.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.679+0000 7f8f18c00640 1 -- 172.21.15.46:0/4212883245 wait complete. 2024-08-17T02:30:46.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.680+0000 7f8f18c00640 1 Processor -- start 2024-08-17T02:30:46.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.680+0000 7f8f18c00640 1 -- start start 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 0x7f8f14069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 0x7f8f140aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14069930 con 0x7f8f14155a20 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14068d20 con 0x7f8f14155df0 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f18c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14069000 con 0x7f8f1406df00 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f11400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f11400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58740/0 (socket says 172.21.15.46:58740) 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.681+0000 7f8f11400640 1 -- 172.21.15.46:0/3475910485 learned_addr learned my addr 172.21.15.46:0/3475910485 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11e00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 0x7f8f14069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 -- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 msgr2=0x7f8f14069dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 0x7f8f14069dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f12800640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 0x7f8f140aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 -- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 msgr2=0x7f8f140aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 0x7f8f140aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 -- 172.21.15.46:0/3475910485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009390 con 0x7f8f14155a20 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11e00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 0x7f8f14069dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f12800640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 0x7f8f140aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f11400640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009850 tx=0x7f8f00032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00031830 con 0x7f8f14155a20 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00031990 con 0x7f8f14155a20 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00031d90 con 0x7f8f14155a20 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f140692e0 con 0x7f8f14155a20 2024-08-17T02:30:46.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.682+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f14150fa0 con 0x7f8f14155a20 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.683+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14069aa0 con 0x7f8f14155a20 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.684+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f0003c400 con 0x7f8f14155a20 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.685+0000 7f8f09600640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 0x7f8ef4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.686+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8f000a2840 con 0x7f8f14155a20 2024-08-17T02:30:46.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.686+0000 7f8f11e00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 0x7f8ef4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:46.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.687+0000 7f8f11e00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 0x7f8ef4067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005840 tx=0x7f8f04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:46.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.690+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f00070650 con 0x7f8f14155a20 2024-08-17T02:30:46.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.872+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f14064db0 con 0x7f8f14155a20 2024-08-17T02:30:46.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.873+0000 7f8f09600640 1 -- 172.21.15.46:0/3475910485 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f8f00073c70 con 0x7f8f14155a20 2024-08-17T02:30:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:46.874 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:42.785711+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 msgr2=0x7f8ef4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 0x7f8ef4067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005840 tx=0x7f8f04009040 comp rx=0 tx=0).stop 2024-08-17T02:30:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 msgr2=0x7f8f140ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009850 tx=0x7f8f00032000 comp rx=0 tx=0).stop 2024-08-17T02:30:46.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 shutdown_connections 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f14155df0 0x7f8f140aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f14155a20 0x7f8f140ac880 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8ef4065150 0x7f8ef4067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 --2- 172.21.15.46:0/3475910485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f1406df00 0x7f8f14069dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 >> 172.21.15.46:0/3475910485 conn(0x7f8f140cb9b0 msgr2=0x7f8f140ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 shutdown_connections 2024-08-17T02:30:46.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:46.875+0000 7f8f18c00640 1 -- 172.21.15.46:0/3475910485 wait complete. 2024-08-17T02:30:46.892 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:46.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:47.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.041+0000 7f805d200640 1 Processor -- start 2024-08-17T02:30:47.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.042+0000 7f805d200640 1 -- start start 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f805d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f80580afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f805d200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80580b03d0 0x7f805815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f805d200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80580ab700 con 0x7f80580cc010 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f805d200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580ab950 con 0x7f80580b03d0 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f805d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80580abc30 con 0x7f80580ab2b0 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f8057400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f80580cc010 0x7f80580a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56610/0 (socket says 172.21.15.46:56610) 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f8057400640 1 -- 172.21.15.46:0/3970533707 learned_addr learned my addr 172.21.15.46:0/3970533707 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f8057e00640 1 --2- 172.21.15.46:0/3970533707 >> v2:172.21.15.46:3300/0 conn(0x7f80580b03d0 0x7f805815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.043+0000 7f804fe00640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f80580afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.044+0000 7f8057e00640 1 -- 172.21.15.46:0/3970533707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 msgr2=0x7f80580afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.044+0000 7f8057e00640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f80580afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.044+0000 7f8057e00640 1 -- 172.21.15.46:0/3970533707 >> v1:172.21.15.46:6789/0 conn(0x7f80580cc010 legacy=0x7f80580a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.044+0000 7f8057e00640 1 -- 172.21.15.46:0/3970533707 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580abf10 con 0x7f80580b03d0 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.044+0000 7f8056a00640 1 -- 172.21.15.46:0/3970533707 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293212275 0 0) 0x7f80580ab700 con 0x7f80580cc010 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f8057e00640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580b03d0 0x7f805815c7c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e60 tx=0x7f8050009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c845d2bb9f13418 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f8056a00640 1 -- 172.21.15.46:0/3970533707 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050007550 con 0x7f80580b03d0 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f8056a00640 1 -- 172.21.15.46:0/3970533707 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805002d050 con 0x7f80580b03d0 2024-08-17T02:30:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f8056a00640 1 -- 172.21.15.46:0/3970533707 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500078e0 con 0x7f80580b03d0 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f805d200640 1 -- 172.21.15.46:0/3970533707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580b03d0 msgr2=0x7f805815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.045+0000 7f805d200640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580b03d0 0x7f805815c7c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8050009e60 tx=0x7f8050009780 comp rx=0 tx=0).stop 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 -- 172.21.15.46:0/3970533707 shutdown_connections 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580b03d0 0x7f805815c7c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 --2- 172.21.15.46:0/3970533707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f80580afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 -- 172.21.15.46:0/3970533707 >> 172.21.15.46:0/3970533707 conn(0x7f8058067de0 msgr2=0x7f80580681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 -- 172.21.15.46:0/3970533707 shutdown_connections 2024-08-17T02:30:47.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.046+0000 7f805d200640 1 -- 172.21.15.46:0/3970533707 wait complete. 2024-08-17T02:30:47.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.047+0000 7f805d200640 1 Processor -- start 2024-08-17T02:30:47.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.047+0000 7f805d200640 1 -- start start 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f805815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80580b03d0 0x7f80580c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80580c1c90 con 0x7f80580cc010 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8058168f00 con 0x7f80580b03d0 2024-08-17T02:30:47.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f805d200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80580c1e80 con 0x7f80580ab2b0 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f8057e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f8057e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58752/0 (socket says 172.21.15.46:58752) 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.048+0000 7f8057e00640 1 -- 172.21.15.46:0/4025006065 learned_addr learned my addr 172.21.15.46:0/4025006065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f804fe00640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80580b03d0 0x7f80580c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057400640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f805815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 -- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 msgr2=0x7f805815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f805815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 -- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80580b03d0 msgr2=0x7f80580c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80580b03d0 0x7f80580c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 -- 172.21.15.46:0/4025006065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050009a20 con 0x7f80580cc010 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f8057e00640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f80500099f0 tx=0x7f8050037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050031a00 con 0x7f80580cc010 2024-08-17T02:30:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050040070 con 0x7f80580cc010 2024-08-17T02:30:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050031db0 con 0x7f80580cc010 2024-08-17T02:30:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.049+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80580c2160 con 0x7f80580cc010 2024-08-17T02:30:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.050+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80580c2720 con 0x7f80580cc010 2024-08-17T02:30:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.050+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058169070 con 0x7f80580cc010 2024-08-17T02:30:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.051+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8050042030 con 0x7f80580cc010 2024-08-17T02:30:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.052+0000 7f804ea00640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 0x7f8034067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.052+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f80500a4250 con 0x7f80580cc010 2024-08-17T02:30:47.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.052+0000 7f8057400640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 0x7f8034067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.053+0000 7f8057400640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 0x7f8034067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f804800c870 tx=0x7f8048009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.056+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8050071ef0 con 0x7f80580cc010 2024-08-17T02:30:47.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.274+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8058071050 con 0x7f80580cc010 2024-08-17T02:30:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.275+0000 7f804ea00640 1 -- 172.21.15.46:0/4025006065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7f8050075510 con 0x7f80580cc010 2024-08-17T02:30:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:47.276 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:47.276 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-08-17T02:30:47.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 msgr2=0x7f8034067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 0x7f8034067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f804800c870 tx=0x7f8048009040 comp rx=0 tx=0).stop 2024-08-17T02:30:47.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 msgr2=0x7f8058154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f80500099f0 tx=0x7f8050037000 comp rx=0 tx=0).stop 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 shutdown_connections 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80580cc010 0x7f8058154e80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80580b03d0 0x7f80580c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8034065150 0x7f8034067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 --2- 172.21.15.46:0/4025006065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80580ab2b0 0x7f805815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 >> 172.21.15.46:0/4025006065 conn(0x7f8058067de0 msgr2=0x7f805806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 shutdown_connections 2024-08-17T02:30:47.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.277+0000 7f805d200640 1 -- 172.21.15.46:0/4025006065 wait complete. 2024-08-17T02:30:47.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:47.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.444+0000 7fad78800640 1 Processor -- start 2024-08-17T02:30:47.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.444+0000 7fad78800640 1 -- start start 2024-08-17T02:30:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad78800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad7006df00 0x7fad700adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad78800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad70155df0 0x7fad700ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad78800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad70156670 con 0x7fad70155a20 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad78800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad700b0350 con 0x7fad70155df0 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad78800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7006e5e0 con 0x7fad7006df00 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.445+0000 7fad76800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad70155df0 0x7fad700ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad70155df0 0x7fad700ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58768/0 (socket says 172.21.15.46:58768) 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 -- 172.21.15.46:0/2786015319 learned_addr learned my addr 172.21.15.46:0/2786015319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad75400640 1 --2- 172.21.15.46:0/2786015319 >> v2:172.21.15.162:3300/0 conn(0x7fad7006df00 0x7fad700adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 -- 172.21.15.46:0/2786015319 >> v2:172.21.15.162:3300/0 conn(0x7fad7006df00 msgr2=0x7fad700adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 --2- 172.21.15.46:0/2786015319 >> v2:172.21.15.162:3300/0 conn(0x7fad7006df00 0x7fad700adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 -- 172.21.15.46:0/2786015319 >> v1:172.21.15.162:6789/0 conn(0x7fad70155a20 legacy=0x7fad7006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.446+0000 7fad76800640 1 -- 172.21.15.46:0/2786015319 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7006e8c0 con 0x7fad70155df0 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.447+0000 7fad76800640 1 --2- 172.21.15.46:0/2786015319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad70155df0 0x7fad700ad9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fad7006aa40 tx=0x7fad6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645aa99666fe768a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.447+0000 7fad74a00640 1 -- 172.21.15.46:0/2786015319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c007400 con 0x7fad70155df0 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.447+0000 7fad74a00640 1 -- 172.21.15.46:0/2786015319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c007560 con 0x7fad70155df0 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.447+0000 7fad74a00640 1 -- 172.21.15.46:0/2786015319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c007940 con 0x7fad70155df0 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 -- 172.21.15.46:0/2786015319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad70155df0 msgr2=0x7fad700ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 --2- 172.21.15.46:0/2786015319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad70155df0 0x7fad700ad9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fad7006aa40 tx=0x7fad6c009840 comp rx=0 tx=0).stop 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 -- 172.21.15.46:0/2786015319 shutdown_connections 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 --2- 172.21.15.46:0/2786015319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad70155df0 0x7fad700ad9b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 --2- 172.21.15.46:0/2786015319 >> v2:172.21.15.162:3300/0 conn(0x7fad7006df00 0x7fad700adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 -- 172.21.15.46:0/2786015319 >> 172.21.15.46:0/2786015319 conn(0x7fad700cb9b0 msgr2=0x7fad700cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:47.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 -- 172.21.15.46:0/2786015319 shutdown_connections 2024-08-17T02:30:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.448+0000 7fad78800640 1 -- 172.21.15.46:0/2786015319 wait complete. 2024-08-17T02:30:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.449+0000 7fad78800640 1 Processor -- start 2024-08-17T02:30:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.450+0000 7fad78800640 1 -- start start 2024-08-17T02:30:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.450+0000 7fad78800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.450+0000 7fad78800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 0x7fad7015be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad78800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 0x7fad7015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad78800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700aaa30 con 0x7fad7006df00 2024-08-17T02:30:47.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad78800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700aad10 con 0x7fad70155a20 2024-08-17T02:30:47.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad78800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700aaff0 con 0x7fad70155df0 2024-08-17T02:30:47.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58770/0 (socket says 172.21.15.46:58770) 2024-08-17T02:30:47.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 -- 172.21.15.46:0/1699538982 learned_addr learned my addr 172.21.15.46:0/1699538982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75400640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 0x7fad7015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad76800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 0x7fad7015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 -- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 msgr2=0x7fad7015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 0x7fad7015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 -- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 msgr2=0x7fad7015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 0x7fad7015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75e00640 1 -- 172.21.15.46:0/1699538982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009ae0 con 0x7fad7006df00 2024-08-17T02:30:47.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad75400640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 0x7fad7015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.451+0000 7fad76800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 0x7fad7015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad75e00640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c560 tx=0x7fad64007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64011590 con 0x7fad7006df00 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad64011710 con 0x7fad7006df00 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64011ad0 con 0x7fad7006df00 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad700ab2d0 con 0x7fad7006df00 2024-08-17T02:30:47.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.452+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7013ff80 con 0x7fad7006df00 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.453+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad700ab7d0 con 0x7fad7006df00 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.454+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad6401b3b0 con 0x7fad7006df00 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.455+0000 7fad69600640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 0x7fad54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.455+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fad64081e10 con 0x7fad7006df00 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.455+0000 7fad75400640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 0x7fad54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.456+0000 7fad75400640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 0x7fad54067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad7006ab50 tx=0x7fad60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.458+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad64085030 con 0x7fad7006df00 2024-08-17T02:30:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.677+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad70064db0 con 0x7fad7006df00 2024-08-17T02:30:47.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.677+0000 7fad69600640 1 -- 172.21.15.46:0/1699538982 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5690 (secure 0 0 0) 0x7fad64017070 con 0x7fad7006df00 2024-08-17T02:30:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:47.679 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:28.130941+0000","modified":"2024-08-17T02:28:31.730126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.46:6835/1370984622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1370984622},{"type":"v1","addr":"172.21.15.46:6835","nonce":1370984622}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:47.679 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.679+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 msgr2=0x7fad54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.679+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 0x7fad54067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fad7006ab50 tx=0x7fad60008040 comp rx=0 tx=0).stop 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.679+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 msgr2=0x7fad700a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.679+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c560 tx=0x7fad64007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 shutdown_connections 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fad54065150 0x7fad54067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad70155df0 0x7fad7015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad70155a20 0x7fad7015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 --2- 172.21.15.46:0/1699538982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad7006df00 0x7fad700a9fb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 >> 172.21.15.46:0/1699538982 conn(0x7fad700cb9b0 msgr2=0x7fad701580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 shutdown_connections 2024-08-17T02:30:47.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.680+0000 7fad78800640 1 -- 172.21.15.46:0/1699538982 wait complete. 2024-08-17T02:30:47.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:47.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.847+0000 7f3673200640 1 Processor -- start 2024-08-17T02:30:47.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.847+0000 7f3673200640 1 -- start start 2024-08-17T02:30:47.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3673200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3674158ad0 0x7f36740ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3673200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f36740afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3673200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3674067d60 con 0x7f3674158ea0 2024-08-17T02:30:47.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3673200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36740aca30 con 0x7f3674158ad0 2024-08-17T02:30:47.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3673200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674068600 con 0x7f36740ac5b0 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.848+0000 7f3671e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3674158ad0 0x7f36740ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3672800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f36740afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3674158ad0 0x7f36740ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:43628/0 (socket says 172.21.15.46:43628) 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 -- 172.21.15.46:0/3170246079 learned_addr learned my addr 172.21.15.46:0/3170246079 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f366be00640 1 --1- 172.21.15.46:0/3170246079 >> v1:172.21.15.162:6789/0 conn(0x7f3674158ea0 0x7f36740af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:40588/0 (socket says 172.21.15.46:40588) 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 -- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 msgr2=0x7f36740afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 --2- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f36740afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 -- 172.21.15.46:0/3170246079 >> v1:172.21.15.162:6789/0 conn(0x7f3674158ea0 legacy=0x7f36740af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671e00640 1 -- 172.21.15.46:0/3170246079 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740b01d0 con 0x7f3674158ad0 2024-08-17T02:30:47.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.849+0000 7f3671400640 1 -- 172.21.15.46:0/3170246079 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196845943 0 0) 0x7f3674067d60 con 0x7f3674158ea0 2024-08-17T02:30:47.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.850+0000 7f3671e00640 1 --2- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ad0 0x7f36740ac070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3664009910 tx=0x7f36640091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b307f8375454eb60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3671400640 1 -- 172.21.15.46:0/3170246079 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366402ad20 con 0x7f3674158ad0 2024-08-17T02:30:47.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3671400640 1 -- 172.21.15.46:0/3170246079 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366402ae80 con 0x7f3674158ad0 2024-08-17T02:30:47.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3671400640 1 -- 172.21.15.46:0/3170246079 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664032670 con 0x7f3674158ad0 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 -- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ad0 msgr2=0x7f36740ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 --2- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ad0 0x7f36740ac070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3664009910 tx=0x7f36640091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 -- 172.21.15.46:0/3170246079 shutdown_connections 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 --2- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f36740afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 --2- 172.21.15.46:0/3170246079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ad0 0x7f36740ac070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 -- 172.21.15.46:0/3170246079 >> 172.21.15.46:0/3170246079 conn(0x7f3674096a70 msgr2=0x7f3674096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 -- 172.21.15.46:0/3170246079 shutdown_connections 2024-08-17T02:30:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.851+0000 7f3673200640 1 -- 172.21.15.46:0/3170246079 wait complete. 2024-08-17T02:30:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.853+0000 7f3673200640 1 Processor -- start 2024-08-17T02:30:47.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.853+0000 7f3673200640 1 -- start start 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f367414c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ea0 0x7f3674156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36740c85b0 con 0x7f3674158ad0 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367414cc10 con 0x7f3674158ea0 2024-08-17T02:30:47.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3673200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36740cd430 con 0x7f36740ac5b0 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58778/0 (socket says 172.21.15.46:58778) 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 -- 172.21.15.46:0/4065340945 learned_addr learned my addr 172.21.15.46:0/4065340945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3672800640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ea0 0x7f3674156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f3671e00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f367414c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 -- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 msgr2=0x7f367414c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f367414c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 -- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ea0 msgr2=0x7f3674156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ea0 0x7f3674156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.854+0000 7f366be00640 1 -- 172.21.15.46:0/4065340945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009450 con 0x7f3674158ad0 2024-08-17T02:30:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f366be00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4f0 tx=0x7f365c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0072e0 con 0x7f3674158ad0 2024-08-17T02:30:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c007460 con 0x7f3674158ad0 2024-08-17T02:30:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0049f0 con 0x7f3674158ad0 2024-08-17T02:30:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740cd710 con 0x7f3674158ad0 2024-08-17T02:30:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.855+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36740cdcd0 con 0x7f3674158ad0 2024-08-17T02:30:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.856+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740c8720 con 0x7f3674158ad0 2024-08-17T02:30:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.857+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f365c013400 con 0x7f3674158ad0 2024-08-17T02:30:47.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.858+0000 7f3669600640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 0x7f3650067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.858+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f365c081fd0 con 0x7f3674158ad0 2024-08-17T02:30:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.858+0000 7f3671e00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 0x7f3650067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:47.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.859+0000 7f3671e00640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 0x7f3650067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3664034000 tx=0x7f3664032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:47.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:47.862+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f365c04fd20 con 0x7f3674158ad0 2024-08-17T02:30:48.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.044+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3674071050 con 0x7f3674158ad0 2024-08-17T02:30:48.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.045+0000 7f3669600640 1 -- 172.21.15.46:0/4065340945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f365c053340 con 0x7f3674158ad0 2024-08-17T02:30:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:48.169 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:28:42.785711+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:26.218610+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:27.110150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:48.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 msgr2=0x7f3650067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 0x7f3650067630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3664034000 tx=0x7f3664032000 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 msgr2=0x7f36740cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4f0 tx=0x7f365c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 shutdown_connections 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3674158ea0 0x7f3674156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3674158ad0 0x7f36740cc950 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3650065180 0x7f3650067630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 --2- 172.21.15.46:0/4065340945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36740ac5b0 0x7f367414c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.047+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 >> 172.21.15.46:0/4065340945 conn(0x7f3674096a70 msgr2=0x7f3674155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.048+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 shutdown_connections 2024-08-17T02:30:48.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.048+0000 7f3673200640 1 -- 172.21.15.46:0/4065340945 wait complete. 2024-08-17T02:30:48.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:30:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.323+0000 7f0dfac00640 1 Processor -- start 2024-08-17T02:30:48.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.323+0000 7f0dfac00640 1 -- start start 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0df41401b0 0x7f0df40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df40b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 0x7f0df40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40cb450 con 0x7f0df41401b0 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40b16d0 con 0x7f0df40b1270 2024-08-17T02:30:48.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0dfac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40caa80 con 0x7f0df4140580 2024-08-17T02:30:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.324+0000 7f0df3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0df41401b0 0x7f0df40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0df41401b0 0x7f0df40caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58790/0 (socket says 172.21.15.46:58790) 2024-08-17T02:30:48.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 -- 172.21.15.46:0/4050455273 learned_addr learned my addr 172.21.15.46:0/4050455273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df8c00640 1 --2- 172.21.15.46:0/4050455273 >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 0x7f0df40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0debe00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df40b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 -- 172.21.15.46:0/4050455273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 msgr2=0x7f0df40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df40b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 -- 172.21.15.46:0/4050455273 >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 msgr2=0x7f0df40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 --2- 172.21.15.46:0/4050455273 >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 0x7f0df40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df3e00640 1 -- 172.21.15.46:0/4050455273 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40c9e70 con 0x7f0df41401b0 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0df8c00640 1 --2- 172.21.15.46:0/4050455273 >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 0x7f0df40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.325+0000 7f0debe00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df40b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:48.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.326+0000 7f0df3e00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40caf10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0df40acbc0 tx=0x7f0de40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c540064247b8efe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.328+0000 7f0df3400640 1 -- 172.21.15.46:0/4050455273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de402ad40 con 0x7f0df41401b0 2024-08-17T02:30:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.328+0000 7f0df3400640 1 -- 172.21.15.46:0/4050455273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4032440 con 0x7f0df41401b0 2024-08-17T02:30:48.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.328+0000 7f0df3400640 1 -- 172.21.15.46:0/4050455273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de402aea0 con 0x7f0df41401b0 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 -- 172.21.15.46:0/4050455273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 msgr2=0x7f0df40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40caf10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0df40acbc0 tx=0x7f0de40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 -- 172.21.15.46:0/4050455273 shutdown_connections 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 --2- 172.21.15.46:0/4050455273 >> v2:172.21.15.162:3300/0 conn(0x7f0df40b1270 0x7f0df40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df40b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 --2- 172.21.15.46:0/4050455273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40caf10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 -- 172.21.15.46:0/4050455273 >> 172.21.15.46:0/4050455273 conn(0x7f0df40cb9b0 msgr2=0x7f0df40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 -- 172.21.15.46:0/4050455273 shutdown_connections 2024-08-17T02:30:48.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.329+0000 7f0dfac00640 1 -- 172.21.15.46:0/4050455273 wait complete. 2024-08-17T02:30:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.330+0000 7f0dfac00640 1 Processor -- start 2024-08-17T02:30:48.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.330+0000 7f0dfac00640 1 -- start start 2024-08-17T02:30:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df40b1270 0x7f0df40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df41549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41551d0 con 0x7f0df41401b0 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c5cb0 con 0x7f0df40b1270 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0dfac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4155420 con 0x7f0df4140580 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.331+0000 7f0debe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58806/0 (socket says 172.21.15.46:58806) 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 -- 172.21.15.46:0/1990061815 learned_addr learned my addr 172.21.15.46:0/1990061815 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0df8c00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df41549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0df3e00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df40b1270 0x7f0df40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 -- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 msgr2=0x7f0df41549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df41549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 -- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df40b1270 msgr2=0x7f0df40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df40b1270 0x7f0df40c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 -- 172.21.15.46:0/1990061815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de4009450 con 0x7f0df41401b0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.332+0000 7f0debe00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c880 tx=0x7f0ddc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.333+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc00ce10 con 0x7f0df41401b0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.333+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc007920 con 0x7f0df41401b0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.333+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc007ca0 con 0x7f0df41401b0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.333+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df4155700 con 0x7f0df41401b0 2024-08-17T02:30:48.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.333+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df4155cc0 con 0x7f0df41401b0 2024-08-17T02:30:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.334+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4155ee0 con 0x7f0df41401b0 2024-08-17T02:30:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.334+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0ddc011600 con 0x7f0df41401b0 2024-08-17T02:30:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.335+0000 7f0deb400640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 0x7f0dd0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.335+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0ddc082760 con 0x7f0df41401b0 2024-08-17T02:30:48.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.336+0000 7f0df3e00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 0x7f0dd0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.337+0000 7f0df3e00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 0x7f0dd0067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0de4034000 tx=0x7f0de4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.339+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0ddc053fe0 con 0x7f0df41401b0 2024-08-17T02:30:48.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.557+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0df4064db0 con 0x7f0df41401b0 2024-08-17T02:30:48.559 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-08-17T02:30:48.558+0000 7f11b8200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:48.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.563+0000 7f0deb400640 1 -- 172.21.15.46:0/1990061815 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0ddc053b70 con 0x7f0df41401b0 2024-08-17T02:30:48.564 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.565+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 msgr2=0x7f0dd0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.565+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 0x7f0dd0067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0de4034000 tx=0x7f0de4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.565+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 msgr2=0x7f0df40c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.565+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c880 tx=0x7f0ddc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 shutdown_connections 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0dd0065150 0x7f0dd0067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df4140580 0x7f0df41549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0df41401b0 0x7f0df40c5770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 --2- 172.21.15.46:0/1990061815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df40b1270 0x7f0df40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 >> 172.21.15.46:0/1990061815 conn(0x7f0df40cb9b0 msgr2=0x7f0df40cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:48.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 shutdown_connections 2024-08-17T02:30:48.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.566+0000 7f0dfac00640 1 -- 172.21.15.46:0/1990061815 wait complete. 2024-08-17T02:30:48.574 INFO:tasks.ceph.mds.c.smithi046.stderr: -7184> 2024-08-17T02:28:32.609+0000 7f99ac400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:48.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:30:48.618 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-08-17T02:30:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.737+0000 7f4b0c200640 1 Processor -- start 2024-08-17T02:30:48.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.737+0000 7f4b0c200640 1 -- start start 2024-08-17T02:30:48.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.738+0000 7f4b0c200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b04156990 0x7f4b040b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.738+0000 7f4b0c200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b040adec0 0x7f4b040b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b0c200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0415b030 con 0x7f4b04156d60 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b0c200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b040af950 con 0x7f4b04156990 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b0c200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b040cc2e0 con 0x7f4b040adec0 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b04156990 0x7f4b040b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4b04156990 0x7f4b040b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58834/0 (socket says 172.21.15.46:58834) 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 -- 172.21.15.46:0/383851581 learned_addr learned my addr 172.21.15.46:0/383851581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b0a200640 1 --2- 172.21.15.46:0/383851581 >> v2:172.21.15.162:3300/0 conn(0x7f4b040adec0 0x7f4b040b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 -- 172.21.15.46:0/383851581 >> v2:172.21.15.162:3300/0 conn(0x7f4b040adec0 msgr2=0x7f4b040b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 --2- 172.21.15.46:0/383851581 >> v2:172.21.15.162:3300/0 conn(0x7f4b040adec0 0x7f4b040b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 -- 172.21.15.46:0/383851581 >> v1:172.21.15.162:6789/0 conn(0x7f4b04156d60 legacy=0x7f4b040ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.739+0000 7f4b09800640 1 -- 172.21.15.46:0/383851581 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b040b1110 con 0x7f4b04156990 2024-08-17T02:30:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.740+0000 7f4b09800640 1 --2- 172.21.15.46:0/383851581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b04156990 0x7f4b040b05a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406bb50 tx=0x7f4af80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fd5c2c8368b5ad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b03e00640 1 -- 172.21.15.46:0/383851581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af802ae80 con 0x7f4b04156990 2024-08-17T02:30:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b03e00640 1 -- 172.21.15.46:0/383851581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8032440 con 0x7f4b04156990 2024-08-17T02:30:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b03e00640 1 -- 172.21.15.46:0/383851581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8032800 con 0x7f4b04156990 2024-08-17T02:30:48.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 -- 172.21.15.46:0/383851581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b04156990 msgr2=0x7f4b040b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 --2- 172.21.15.46:0/383851581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b04156990 0x7f4b040b05a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b0406bb50 tx=0x7f4af80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 -- 172.21.15.46:0/383851581 shutdown_connections 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 --2- 172.21.15.46:0/383851581 >> v2:172.21.15.162:3300/0 conn(0x7f4b040adec0 0x7f4b040b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 --2- 172.21.15.46:0/383851581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b04156990 0x7f4b040b05a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.741+0000 7f4b0c200640 1 -- 172.21.15.46:0/383851581 >> 172.21.15.46:0/383851581 conn(0x7f4b04067750 msgr2=0x7f4b040cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.742+0000 7f4b0c200640 1 -- 172.21.15.46:0/383851581 shutdown_connections 2024-08-17T02:30:48.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.742+0000 7f4b0c200640 1 -- 172.21.15.46:0/383851581 wait complete. 2024-08-17T02:30:48.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.743+0000 7f4b0c200640 1 Processor -- start 2024-08-17T02:30:48.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.743+0000 7f4b0c200640 1 -- start start 2024-08-17T02:30:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b04156990 0x7f4b04148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b04156d60 0x7f4b0406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0416d720 con 0x7f4b040adec0 2024-08-17T02:30:48.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040ab5a0 con 0x7f4b04156990 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0c200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b040ab880 con 0x7f4b04156d60 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b09800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b09800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58846/0 (socket says 172.21.15.46:58846) 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b09800640 1 -- 172.21.15.46:0/54475760 learned_addr learned my addr 172.21.15.46:0/54475760 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b08e00640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b04156990 0x7f4b04148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.744+0000 7f4b0a200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b04156d60 0x7f4b0406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 -- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b04156d60 msgr2=0x7f4b0406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b04156d60 0x7f4b0406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 -- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b04156990 msgr2=0x7f4b04148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b04156990 0x7f4b04148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:48.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 -- 172.21.15.46:0/54475760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009450 con 0x7f4b040adec0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b09800640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009210 tx=0x7f4af8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8031bb0 con 0x7f4b040adec0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8031d30 con 0x7f4b040adec0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b040abb60 con 0x7f4b040adec0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af803d670 con 0x7f4b040adec0 2024-08-17T02:30:48.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.745+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04169030 con 0x7f4b040adec0 2024-08-17T02:30:48.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.746+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04071050 con 0x7f4b040adec0 2024-08-17T02:30:48.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.747+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4af8039040 con 0x7f4b040adec0 2024-08-17T02:30:48.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.748+0000 7f4b00c00640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 0x7f4ae4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:48.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.748+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f4af80a29e0 con 0x7f4b040adec0 2024-08-17T02:30:48.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.749+0000 7f4b08e00640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 0x7f4ae4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:48.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.750+0000 7f4b08e00640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 0x7f4ae4067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b040ae4b0 tx=0x7f4af0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:48.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.752+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4af8070620 con 0x7f4b040adec0 2024-08-17T02:30:48.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:48.982+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b040640d0 con 0x7f4b040adec0 2024-08-17T02:30:49.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.567+0000 7f4b00c00640 1 -- 172.21.15.46:0/54475760 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4af8073c40 con 0x7f4b040adec0 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 msgr2=0x7f4ae4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 0x7f4ae4067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b040ae4b0 tx=0x7f4af0009040 comp rx=0 tx=0).stop 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 msgr2=0x7f4b04168af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009210 tx=0x7f4af8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 shutdown_connections 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4ae4065150 0x7f4ae4067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b04156d60 0x7f4b0406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b04156990 0x7f4b04148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 --2- 172.21.15.46:0/54475760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b040adec0 0x7f4b04168af0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 >> 172.21.15.46:0/54475760 conn(0x7f4b04067750 msgr2=0x7f4b04155930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 shutdown_connections 2024-08-17T02:30:49.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.570+0000 7f4b0c200640 1 -- 172.21.15.46:0/54475760 wait complete. 2024-08-17T02:30:49.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:30:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.792+0000 7fa722800640 1 Processor -- start 2024-08-17T02:30:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.792+0000 7fa722800640 1 -- start start 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.793+0000 7fa722800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa71c156d40 0x7fa71c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.793+0000 7fa722800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c06e880 con 0x7fa71c150130 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.793+0000 7fa722800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c1568b0 con 0x7fa71c06e420 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.793+0000 7fa722800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c150500 con 0x7fa71c156d40 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa71c156d40 0x7fa71c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa71c156d40 0x7fa71c06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58860/0 (socket says 172.21.15.46:58860) 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 -- 172.21.15.46:0/3632857303 learned_addr learned my addr 172.21.15.46:0/3632857303 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa71b400640 1 --1- 172.21.15.46:0/3632857303 >> v1:172.21.15.46:6789/0 conn(0x7fa71c150130 0x7fa71c0aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:56618/0 (socket says 172.21.15.46:56618) 2024-08-17T02:30:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 -- 172.21.15.46:0/3632857303 >> v1:172.21.15.162:6789/0 conn(0x7fa71c06e420 legacy=0x7fa71c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 -- 172.21.15.46:0/3632857303 >> v1:172.21.15.46:6789/0 conn(0x7fa71c150130 legacy=0x7fa71c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa71aa00640 1 -- 172.21.15.46:0/3632857303 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262046622 0 0) 0x7fa70c001110 con 0x7fa71c150130 2024-08-17T02:30:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.794+0000 7fa712a00640 1 -- 172.21.15.46:0/3632857303 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c155fc0 con 0x7fa71c156d40 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.795+0000 7fa712a00640 1 --2- 172.21.15.46:0/3632857303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c156d40 0x7fa71c06dee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa704009910 tx=0x7fa7040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a298147ed27e55c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.795+0000 7fa71aa00640 1 -- 172.21.15.46:0/3632857303 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70402add0 con 0x7fa71c156d40 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa71aa00640 1 -- 172.21.15.46:0/3632857303 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704032440 con 0x7fa71c156d40 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa71aa00640 1 -- 172.21.15.46:0/3632857303 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7040327e0 con 0x7fa71c156d40 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 -- 172.21.15.46:0/3632857303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c156d40 msgr2=0x7fa71c06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 --2- 172.21.15.46:0/3632857303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c156d40 0x7fa71c06dee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa704009910 tx=0x7fa7040091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 -- 172.21.15.46:0/3632857303 shutdown_connections 2024-08-17T02:30:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 --2- 172.21.15.46:0/3632857303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c156d40 0x7fa71c06dee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 -- 172.21.15.46:0/3632857303 >> 172.21.15.46:0/3632857303 conn(0x7fa71c067750 msgr2=0x7fa71c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 -- 172.21.15.46:0/3632857303 shutdown_connections 2024-08-17T02:30:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.796+0000 7fa722800640 1 -- 172.21.15.46:0/3632857303 wait complete. 2024-08-17T02:30:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.797+0000 7fa722800640 1 Processor -- start 2024-08-17T02:30:49.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.798+0000 7fa722800640 1 -- start start 2024-08-17T02:30:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.798+0000 7fa722800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa71c06e420 0x7fa71c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.798+0000 7fa722800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa722800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 0x7fa71c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa722800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0a5a10 con 0x7fa71c150130 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa722800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c159ac0 con 0x7fa71c156d40 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa722800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c157670 con 0x7fa71c06e420 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58876/0 (socket says 172.21.15.46:58876) 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 -- 172.21.15.46:0/516309215 learned_addr learned my addr 172.21.15.46:0/516309215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa71be00640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 0x7fa71c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa71b400640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa71c06e420 0x7fa71c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 -- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa71c06e420 msgr2=0x7fa71c0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa71c06e420 0x7fa71c0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 -- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 msgr2=0x7fa71c1451f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 0x7fa71c1451f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa712a00640 1 -- 172.21.15.46:0/516309215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa704009450 con 0x7fa71c150130 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.799+0000 7fa71be00640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 0x7fa71c1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa712a00640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa704009970 tx=0x7fa704032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704031a60 con 0x7fa71c150130 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704031c00 con 0x7fa71c150130 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c169af0 con 0x7fa71c150130 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704046430 con 0x7fa71c150130 2024-08-17T02:30:49.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.800+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c159ff0 con 0x7fa71c150130 2024-08-17T02:30:49.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.801+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c0710c0 con 0x7fa71c150130 2024-08-17T02:30:49.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.802+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa704039040 con 0x7fa71c150130 2024-08-17T02:30:49.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.803+0000 7fa713400640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:49.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.804+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fa704041030 con 0x7fa71c150130 2024-08-17T02:30:49.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.804+0000 7fa71b400640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:49.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.805+0000 7fa71b400640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 0x7fa6f8067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0074b0 tx=0x7fa70c0079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:49.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.808+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa704070e60 con 0x7fa71c150130 2024-08-17T02:30:49.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:49.991+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa71c14e6e0 con 0x7fa71c150130 2024-08-17T02:30:50.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.569+0000 7fa713400640 1 -- 172.21.15.46:0/516309215 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa7040370d0 con 0x7fa71c150130 2024-08-17T02:30:50.570 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:30:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 msgr2=0x7fa6f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 0x7fa6f8067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0074b0 tx=0x7fa70c0079a0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 msgr2=0x7fa71c157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa704009970 tx=0x7fa704032000 comp rx=0 tx=0).stop 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 shutdown_connections 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71c156d40 0x7fa71c1451f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa71c150130 0x7fa71c157130 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa6f8065150 0x7fa6f8067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 --2- 172.21.15.46:0/516309215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa71c06e420 0x7fa71c0a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 >> 172.21.15.46:0/516309215 conn(0x7fa71c067750 msgr2=0x7fa71c14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.571+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 shutdown_connections 2024-08-17T02:30:50.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.572+0000 7fa722800640 1 -- 172.21.15.46:0/516309215 wait complete. 2024-08-17T02:30:50.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:30:50.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.743+0000 7f486ee00640 1 Processor -- start 2024-08-17T02:30:50.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.743+0000 7f486ee00640 1 -- start start 2024-08-17T02:30:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4868150130 0x7f48680aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 0x7f486806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 0x7f48680afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486806e8a0 con 0x7f4868150130 2024-08-17T02:30:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48681568b0 con 0x7f486806e420 2024-08-17T02:30:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f486ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4868150500 con 0x7f4868156d40 2024-08-17T02:30:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.744+0000 7f4867e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4868150130 0x7f48680aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4868150130 0x7f48680aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39196/0 (socket says 172.21.15.46:39196) 2024-08-17T02:30:50.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 -- 172.21.15.46:0/1153286338 learned_addr learned my addr 172.21.15.46:0/1153286338 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 -- 172.21.15.46:0/1153286338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 msgr2=0x7f486806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867400640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 0x7f486806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f486ce00640 1 --2- 172.21.15.46:0/1153286338 >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 0x7f48680afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 0x7f486806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 -- 172.21.15.46:0/1153286338 >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 msgr2=0x7f48680afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:50.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 --2- 172.21.15.46:0/1153286338 >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 0x7f48680afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867e00640 1 -- 172.21.15.46:0/1153286338 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868155fc0 con 0x7f4868150130 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f486ce00640 1 --2- 172.21.15.46:0/1153286338 >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 0x7f48680afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.745+0000 7f4867400640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 0x7f486806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.746+0000 7f4867e00640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4868150130 0x7f48680aa730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f486806c250 tx=0x7f48580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baf8d6a561ecb86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.746+0000 7f4866a00640 1 -- 172.21.15.46:0/1153286338 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485802ad40 con 0x7f4868150130 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.746+0000 7f4866a00640 1 -- 172.21.15.46:0/1153286338 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858032440 con 0x7f4868150130 2024-08-17T02:30:50.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.746+0000 7f4866a00640 1 -- 172.21.15.46:0/1153286338 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485802aea0 con 0x7f4868150130 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 -- 172.21.15.46:0/1153286338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4868150130 msgr2=0x7f48680aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4868150130 0x7f48680aa730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f486806c250 tx=0x7f48580091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 -- 172.21.15.46:0/1153286338 shutdown_connections 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 --2- 172.21.15.46:0/1153286338 >> v2:172.21.15.162:3300/0 conn(0x7f486806e420 0x7f48680afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868156d40 0x7f486806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 --2- 172.21.15.46:0/1153286338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4868150130 0x7f48680aa730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 -- 172.21.15.46:0/1153286338 >> 172.21.15.46:0/1153286338 conn(0x7f4868067750 msgr2=0x7f486806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 -- 172.21.15.46:0/1153286338 shutdown_connections 2024-08-17T02:30:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.747+0000 7f486ee00640 1 -- 172.21.15.46:0/1153286338 wait complete. 2024-08-17T02:30:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.748+0000 7f486ee00640 1 Processor -- start 2024-08-17T02:30:50.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.749+0000 7f486ee00640 1 -- start start 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868150130 0x7f4868157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4868156d40 0x7f4868169250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868147e80 con 0x7f486806e420 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868169a80 con 0x7f4868156d40 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4868169d60 con 0x7f4868150130 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39204/0 (socket says 172.21.15.46:39204) 2024-08-17T02:30:50.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 -- 172.21.15.46:0/2640531694 learned_addr learned my addr 172.21.15.46:0/2640531694 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f486ce00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4868156d40 0x7f4868169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867400640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868150130 0x7f4868157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 -- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868150130 msgr2=0x7f4868157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868150130 0x7f4868157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 -- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4868156d40 msgr2=0x7f4868169250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4868156d40 0x7f4868169250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.750+0000 7f4867e00640 1 -- 172.21.15.46:0/2640531694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858009450 con 0x7f486806e420 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f4867e00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4858035040 tx=0x7f4858032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858031a60 con 0x7f486806e420 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858031be0 con 0x7f486806e420 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486816a040 con 0x7f486806e420 2024-08-17T02:30:50.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485803d420 con 0x7f486806e420 2024-08-17T02:30:50.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.751+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48681576a0 con 0x7f486806e420 2024-08-17T02:30:50.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.752+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48681697f0 con 0x7f486806e420 2024-08-17T02:30:50.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.753+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4858039040 con 0x7f486806e420 2024-08-17T02:30:50.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.753+0000 7f485f400640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 0x7f4848067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:50.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.754+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f48580a2580 con 0x7f486806e420 2024-08-17T02:30:50.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.754+0000 7f4867400640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 0x7f4848067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:50.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.755+0000 7f4867400640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 0x7f4848067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4854006fd0 tx=0x7f4854008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:50.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.758+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4858070420 con 0x7f486806e420 2024-08-17T02:30:50.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:50.939+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f48680710c0 con 0x7f486806e420 2024-08-17T02:30:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.575+0000 7f485f400640 1 -- 172.21.15.46:0/2640531694 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4858073a40 con 0x7f486806e420 2024-08-17T02:30:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-08-17T02:30:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 msgr2=0x7f4848067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 0x7f4848067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4854006fd0 tx=0x7f4854008040 comp rx=0 tx=0).stop 2024-08-17T02:30:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 msgr2=0x7f48680caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4858035040 tx=0x7f4858032000 comp rx=0 tx=0).stop 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 shutdown_connections 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4868156d40 0x7f4868169250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f4848065150 0x7f4848067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4868150130 0x7f4868157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 --2- 172.21.15.46:0/2640531694 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f486806e420 0x7f48680caf60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.578+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 >> 172.21.15.46:0/2640531694 conn(0x7f4868067750 msgr2=0x7f48680ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.579+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 shutdown_connections 2024-08-17T02:30:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.579+0000 7f486ee00640 1 -- 172.21.15.46:0/2640531694 wait complete. 2024-08-17T02:30:51.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.749+0000 7fd673200640 1 Processor -- start 2024-08-17T02:30:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.749+0000 7fd673200640 1 -- start start 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd673200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd674158bd0 0x7fd674069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd673200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd6740ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd673200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6740aec20 con 0x7fd6740ac540 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd673200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6740699c0 con 0x7fd674158bd0 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd673200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740ae330 con 0x7fd674069540 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd672800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd6740ac540 0x7fd674067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43360/0 (socket says 172.21.15.46:43360) 2024-08-17T02:30:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.750+0000 7fd672800640 1 -- 172.21.15.46:0/352876199 learned_addr learned my addr 172.21.15.46:0/352876199 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd671e00640 1 --2- 172.21.15.46:0/352876199 >> v2:172.21.15.162:3300/0 conn(0x7fd674158bd0 0x7fd674069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd671400640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd6740ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929013141 0 0) 0x7fd6740aec20 con 0x7fd6740ac540 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6580034e0 con 0x7fd6740ac540 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2267325719 0 0) 0x7fd6580034e0 con 0x7fd6740ac540 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 msgr2=0x7fd6740ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd6740ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 >> v2:172.21.15.162:3300/0 conn(0x7fd674158bd0 msgr2=0x7fd674069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 --2- 172.21.15.46:0/352876199 >> v2:172.21.15.162:3300/0 conn(0x7fd674158bd0 0x7fd674069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740acd30 con 0x7fd6740ac540 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7fd66c0017f0 con 0x7fd6740ac540 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 >> v1:172.21.15.46:6789/0 conn(0x7fd6740ac540 legacy=0x7fd674067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658003a50 0x7fd658003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd658004780 0x7fd658004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd658005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740699c0 con 0x7fd658004780 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740ae330 con 0x7fd658003a50 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65800bab0 con 0x7fd674069540 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.751+0000 7fd671e00640 1 --2- 172.21.15.46:0/352876199 >> v2:172.21.15.162:3300/0 conn(0x7fd674158bd0 0x7fd674069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd658004780 0x7fd658004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd672800640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd658005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671e00640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658003a50 0x7fd658003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 -- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 msgr2=0x7fd658005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd674069540 0x7fd658005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 -- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658003a50 msgr2=0x7fd658003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658003a50 0x7fd658003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.752+0000 7fd671400640 1 -- 172.21.15.46:0/352876199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580034e0 con 0x7fd658004780 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.753+0000 7fd671400640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd658004780 0x7fd658004bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd660009b70 tx=0x7fd6600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534df7be7a51749d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.753+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660031400 con 0x7fd658004780 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.753+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66002d050 con 0x7fd658004780 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.753+0000 7fd670a00640 1 -- 172.21.15.46:0/352876199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660031790 con 0x7fd658004780 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 -- 172.21.15.46:0/352876199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd658004780 msgr2=0x7fd658004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 --2- 172.21.15.46:0/352876199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd658004780 0x7fd658004bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd660009b70 tx=0x7fd6600090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd672800640 1 -- 172.21.15.46:0/352876199 reap_dead start 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 -- 172.21.15.46:0/352876199 shutdown_connections 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 -- 172.21.15.46:0/352876199 >> 172.21.15.46:0/352876199 conn(0x7fd674096a70 msgr2=0x7fd6740cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 -- 172.21.15.46:0/352876199 shutdown_connections 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.754+0000 7fd673200640 1 -- 172.21.15.46:0/352876199 wait complete. 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.755+0000 7fd673200640 1 Processor -- start 2024-08-17T02:30:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.755+0000 7fd673200640 1 -- start start 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658004780 0x7fd6740998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6740c8f40 0x7fd6740c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740c98f0 con 0x7fd674169850 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67409adb0 con 0x7fd658004780 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.756+0000 7fd673200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67416a1c0 con 0x7fd6740c8f40 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39210/0 (socket says 172.21.15.46:39210) 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 -- 172.21.15.46:0/1661159553 learned_addr learned my addr 172.21.15.46:0/1661159553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd671e00640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658004780 0x7fd6740998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd671400640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6740c8f40 0x7fd6740c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 -- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6740c8f40 msgr2=0x7fd6740c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6740c8f40 0x7fd6740c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 -- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658004780 msgr2=0x7fd6740998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658004780 0x7fd6740998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 -- 172.21.15.46:0/1661159553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67409b240 con 0x7fd674169850 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.757+0000 7fd672800640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd67406e0d0 tx=0x7fd66c001380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.758+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c010520 con 0x7fd674169850 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.758+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c010680 con 0x7fd674169850 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.758+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c010a40 con 0x7fd674169850 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.758+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67409a1a0 con 0x7fd674169850 2024-08-17T02:30:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.758+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67409a760 con 0x7fd674169850 2024-08-17T02:30:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.759+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd674071050 con 0x7fd674169850 2024-08-17T02:30:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.759+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd66c0133e0 con 0x7fd674169850 2024-08-17T02:30:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.761+0000 7fd669600640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 0x7fd654067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.761+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fd66c081e50 con 0x7fd674169850 2024-08-17T02:30:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.761+0000 7fd671e00640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 0x7fd654067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.762+0000 7fd671e00640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 0x7fd654067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd664009f50 tx=0x7fd664008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.765+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd66c04fea0 con 0x7fd674169850 2024-08-17T02:30:51.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.949+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6740ab930 con 0x7fd674169850 2024-08-17T02:30:51.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.950+0000 7fd669600640 1 -- 172.21.15.46:0/1661159553 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15512 (secure 0 0 0) 0x7fd66c019020 con 0x7fd674169850 2024-08-17T02:30:51.951 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:51.951 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:30:51.569091+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6835/1370984622":"2024-08-18T02:30:48.559373+0000","172.21.15.46:6834/1370984622":"2024-08-18T02:30:48.559373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 msgr2=0x7fd654067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 0x7fd654067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd664009f50 tx=0x7fd664008040 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 msgr2=0x7fd674169c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd67406e0d0 tx=0x7fd66c001380 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 shutdown_connections 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd674169850 0x7fd674169c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fd654065150 0x7fd654067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6740c8f40 0x7fd6740c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 --2- 172.21.15.46:0/1661159553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd658004780 0x7fd6740998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 >> 172.21.15.46:0/1661159553 conn(0x7fd674096a70 msgr2=0x7fd6740aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 shutdown_connections 2024-08-17T02:30:51.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:51.953+0000 7fd673200640 1 -- 172.21.15.46:0/1661159553 wait complete. 2024-08-17T02:30:51.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:33.065453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000237964.meta', 'create_time': '2024-08-17T02:28:38.969348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000237964'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000237964.data', 'create_time': '2024-08-17T02:28:39.821358+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000237964'}}}] 2024-08-17T02:30:51.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:52.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.123+0000 7fdf33200640 1 Processor -- start 2024-08-17T02:30:52.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.123+0000 7fdf33200640 1 -- start start 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.124+0000 7fdf33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.124+0000 7fdf33200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf2c158f60 0x7fdf2c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.124+0000 7fdf33200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0ac390 con 0x7fdf2c0cc5f0 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.124+0000 7fdf33200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0ab4a0 con 0x7fdf2c158f60 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.124+0000 7fdf33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0ab780 con 0x7fdf2c158b90 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf2c158f60 0x7fdf2c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdf2c158f60 0x7fdf2c0aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39214/0 (socket says 172.21.15.46:39214) 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 -- 172.21.15.46:0/4121442871 learned_addr learned my addr 172.21.15.46:0/4121442871 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf31200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdf2c0cc5f0 0x7fdf2c0ac820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43374/0 (socket says 172.21.15.46:43374) 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2be00640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 -- 172.21.15.46:0/4121442871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 msgr2=0x7fdf2c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 -- 172.21.15.46:0/4121442871 >> v1:172.21.15.46:6789/0 conn(0x7fdf2c0cc5f0 legacy=0x7fdf2c0ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2aa00640 1 -- 172.21.15.46:0/4121442871 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287042635 0 0) 0x7fdf2c0ac390 con 0x7fdf2c0cc5f0 2024-08-17T02:30:52.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.125+0000 7fdf2b400640 1 -- 172.21.15.46:0/4121442871 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0aba60 con 0x7fdf2c158f60 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.126+0000 7fdf2b400640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0aef80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009910 tx=0x7fdf180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ac6c41ed3f1ef6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.126+0000 7fdf2aa00640 1 -- 172.21.15.46:0/4121442871 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1802ae40 con 0x7fdf2c158f60 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf2aa00640 1 -- 172.21.15.46:0/4121442871 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18032440 con 0x7fdf2c158f60 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf2aa00640 1 -- 172.21.15.46:0/4121442871 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180327e0 con 0x7fdf2c158f60 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 -- 172.21.15.46:0/4121442871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 msgr2=0x7fdf2c0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0aef80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009910 tx=0x7fdf180091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 -- 172.21.15.46:0/4121442871 shutdown_connections 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0aef80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 --2- 172.21.15.46:0/4121442871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 -- 172.21.15.46:0/4121442871 >> 172.21.15.46:0/4121442871 conn(0x7fdf2c067750 msgr2=0x7fdf2c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 -- 172.21.15.46:0/4121442871 shutdown_connections 2024-08-17T02:30:52.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.127+0000 7fdf33200640 1 -- 172.21.15.46:0/4121442871 wait complete. 2024-08-17T02:30:52.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.128+0000 7fdf33200640 1 Processor -- start 2024-08-17T02:30:52.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.129+0000 7fdf33200640 1 -- start start 2024-08-17T02:30:52.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.129+0000 7fdf33200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf2c0cc5f0 0x7fdf2c14caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.129+0000 7fdf33200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.129+0000 7fdf33200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf33200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c8eb0 con 0x7fdf2c158f60 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf33200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c14d030 con 0x7fdf2c0cc5f0 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf33200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c82a0 con 0x7fdf2c158b90 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39228/0 (socket says 172.21.15.46:39228) 2024-08-17T02:30:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 -- 172.21.15.46:0/2397231563 learned_addr learned my addr 172.21.15.46:0/2397231563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 -- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 msgr2=0x7fdf2c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 -- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf2c0cc5f0 msgr2=0x7fdf2c14caf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf2c0cc5f0 0x7fdf2c14caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 -- 172.21.15.46:0/2397231563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18009450 con 0x7fdf2c158f60 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.130+0000 7fdf31200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400c890 tx=0x7fdf24007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.131+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400ce80 con 0x7fdf2c158f60 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.131+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf24005d60 con 0x7fdf2c158f60 2024-08-17T02:30:52.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.131+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400a870 con 0x7fdf2c158f60 2024-08-17T02:30:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.131+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0c8580 con 0x7fdf2c158f60 2024-08-17T02:30:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.131+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0c8b40 con 0x7fdf2c158f60 2024-08-17T02:30:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.132+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c064db0 con 0x7fdf2c158f60 2024-08-17T02:30:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.133+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf2400aca0 con 0x7fdf2c158f60 2024-08-17T02:30:52.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.133+0000 7fdf23400640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 0x7fdf0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.134+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fdf24082260 con 0x7fdf2c158f60 2024-08-17T02:30:52.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.134+0000 7fdf2be00640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 0x7fdf0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.135+0000 7fdf2be00640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 0x7fdf0c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006fd0 tx=0x7fdf1c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.138+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf24050320 con 0x7fdf2c158f60 2024-08-17T02:30:52.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.317+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf2c0c8ff0 con 0x7fdf2c158f60 2024-08-17T02:30:52.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.318+0000 7fdf23400640 1 -- 172.21.15.46:0/2397231563 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf24053940 con 0x7fdf2c158f60 2024-08-17T02:30:52.319 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-08-17T02:30:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 msgr2=0x7fdf0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 0x7fdf0c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006fd0 tx=0x7fdf1c008040 comp rx=0 tx=0).stop 2024-08-17T02:30:52.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 msgr2=0x7fdf2c0696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400c890 tx=0x7fdf24007f90 comp rx=0 tx=0).stop 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 shutdown_connections 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf2c158f60 0x7fdf2c0696a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdf0c065150 0x7fdf0c067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf2c158b90 0x7fdf2c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 --2- 172.21.15.46:0/2397231563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf2c0cc5f0 0x7fdf2c14caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 >> 172.21.15.46:0/2397231563 conn(0x7fdf2c067750 msgr2=0x7fdf2c0aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 shutdown_connections 2024-08-17T02:30:52.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.320+0000 7fdf33200640 1 -- 172.21.15.46:0/2397231563 wait complete. 2024-08-17T02:30:52.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000237964.meta pg_num 2024-08-17T02:30:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.489+0000 7f54fac00640 1 Processor -- start 2024-08-17T02:30:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.489+0000 7f54fac00640 1 -- start start 2024-08-17T02:30:52.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.490+0000 7f54fac00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54f415c930 0x7f54f40af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54fac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f40c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54fac00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f40c6b90 con 0x7f54f40aee00 2024-08-17T02:30:52.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54fac00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f415d950 con 0x7f54f415c930 2024-08-17T02:30:52.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54fac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40c6710 con 0x7f54f40c5d50 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54f415c930 0x7f54f40af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f54f415c930 0x7f54f40af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39234/0 (socket says 172.21.15.46:39234) 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 -- 172.21.15.46:0/2675802635 learned_addr learned my addr 172.21.15.46:0/2675802635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3e00640 1 --1- 172.21.15.46:0/2675802635 >> v1:172.21.15.46:6789/0 conn(0x7f54f40aee00 0x7f54f4159d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43378/0 (socket says 172.21.15.46:43378) 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f8c00640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f40c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 -- 172.21.15.46:0/2675802635 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 msgr2=0x7f54f40c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f40c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 -- 172.21.15.46:0/2675802635 >> v1:172.21.15.46:6789/0 conn(0x7f54f40aee00 legacy=0x7f54f4159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.491+0000 7f54f3400640 1 -- 172.21.15.46:0/2675802635 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f415cdd0 con 0x7f54f415c930 2024-08-17T02:30:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.492+0000 7f54f3400640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40af1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009910 tx=0x7f54e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e434dc3583fac42f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54f2a00640 1 -- 172.21.15.46:0/2675802635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e002ae40 con 0x7f54f415c930 2024-08-17T02:30:52.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54f2a00640 1 -- 172.21.15.46:0/2675802635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0032440 con 0x7f54f415c930 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54f2a00640 1 -- 172.21.15.46:0/2675802635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0032820 con 0x7f54f415c930 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 -- 172.21.15.46:0/2675802635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 msgr2=0x7f54f40af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40af1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009910 tx=0x7f54e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 -- 172.21.15.46:0/2675802635 shutdown_connections 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f40c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 --2- 172.21.15.46:0/2675802635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40af1d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 -- 172.21.15.46:0/2675802635 >> 172.21.15.46:0/2675802635 conn(0x7f54f40cd4b0 msgr2=0x7f54f40c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 -- 172.21.15.46:0/2675802635 shutdown_connections 2024-08-17T02:30:52.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.493+0000 7f54fac00640 1 -- 172.21.15.46:0/2675802635 wait complete. 2024-08-17T02:30:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.495+0000 7f54fac00640 1 Processor -- start 2024-08-17T02:30:52.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.495+0000 7f54fac00640 1 -- start start 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f40aee00 0x7f54f4154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f41555e0 con 0x7f54f415c930 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f415b5b0 con 0x7f54f40aee00 2024-08-17T02:30:52.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54fac00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f40b00c0 con 0x7f54f40c5d50 2024-08-17T02:30:52.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39238/0 (socket says 172.21.15.46:39238) 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 -- 172.21.15.46:0/1226254796 learned_addr learned my addr 172.21.15.46:0/1226254796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f3e00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f40aee00 0x7f54f4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f3400640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 -- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 msgr2=0x7f54f414f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f414f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 -- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f40aee00 msgr2=0x7f54f4154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f40aee00 0x7f54f4154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.496+0000 7f54f8c00640 1 -- 172.21.15.46:0/1226254796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009450 con 0x7f54f415c930 2024-08-17T02:30:52.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54f8c00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009fd0 tx=0x7f54ec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00ee90 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec014420 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f40b0380 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ec0147e0 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.497+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4155020 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.498+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f40b0510 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.499+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f54ec014b50 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.500+0000 7f54eb400640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 0x7f54d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.500+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f54ec082b50 con 0x7f54f415c930 2024-08-17T02:30:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.500+0000 7f54f3e00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 0x7f54d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.501+0000 7f54f3e00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 0x7f54d4067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54e4007800 tx=0x7f54e4007e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.504+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54ec050c40 con 0x7f54f415c930 2024-08-17T02:30:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.686+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.meta", "var": "pg_num"} v 0) v1 -- 0x7f54f4071050 con 0x7f54f415c930 2024-08-17T02:30:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.686+0000 7f54eb400640 1 -- 172.21.15.46:0/1226254796 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.meta", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7f54ec054260 con 0x7f54f415c930 2024-08-17T02:30:52.687 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:30:52.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 msgr2=0x7f54d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 0x7f54d4067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54e4007800 tx=0x7f54e4007e20 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 msgr2=0x7f54f40cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009fd0 tx=0x7f54ec009900 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 shutdown_connections 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54f415c930 0x7f54f40cb2a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f54d4065150 0x7f54d4067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f40c5d50 0x7f54f414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 --2- 172.21.15.46:0/1226254796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54f40aee00 0x7f54f4154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 >> 172.21.15.46:0/1226254796 conn(0x7f54f40cd4b0 msgr2=0x7f54f406afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 shutdown_connections 2024-08-17T02:30:52.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.688+0000 7f54fac00640 1 -- 172.21.15.46:0/1226254796 wait complete. 2024-08-17T02:30:52.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000237964.data pg_num 2024-08-17T02:30:52.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.866+0000 7fe677200640 1 Processor -- start 2024-08-17T02:30:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.867+0000 7fe677200640 1 -- start start 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670069230 0x7fe670069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe670096e70 0x7fe6700abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe670067de0 0x7fe670068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700ad010 con 0x7fe670096e70 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700ac4f0 con 0x7fe670067de0 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe677200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700ae3a0 con 0x7fe670069230 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe675400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe670096e70 0x7fe6700abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe675400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe670096e70 0x7fe6700abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39254/0 (socket says 172.21.15.46:39254) 2024-08-17T02:30:52.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe675400640 1 -- 172.21.15.46:0/1157019323 learned_addr learned my addr 172.21.15.46:0/1157019323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.868+0000 7fe676800640 1 --2- 172.21.15.46:0/1157019323 >> v2:172.21.15.162:3300/0 conn(0x7fe670067de0 0x7fe670068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675e00640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670069230 0x7fe670069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675400640 1 -- 172.21.15.46:0/1157019323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670069230 msgr2=0x7fe670069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675400640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670069230 0x7fe670069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675400640 1 -- 172.21.15.46:0/1157019323 >> v2:172.21.15.162:3300/0 conn(0x7fe670067de0 msgr2=0x7fe670068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675400640 1 --2- 172.21.15.46:0/1157019323 >> v2:172.21.15.162:3300/0 conn(0x7fe670067de0 0x7fe670068200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.869+0000 7fe675400640 1 -- 172.21.15.46:0/1157019323 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700ac770 con 0x7fe670096e70 2024-08-17T02:30:52.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.870+0000 7fe675400640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670096e70 0x7fe6700abfb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe670064600 tx=0x7fe6600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe0f1515285ec4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.870+0000 7fe674a00640 1 -- 172.21.15.46:0/1157019323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66002acb0 con 0x7fe670096e70 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.870+0000 7fe674a00640 1 -- 172.21.15.46:0/1157019323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66002ae10 con 0x7fe670096e70 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.870+0000 7fe674a00640 1 -- 172.21.15.46:0/1157019323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660032670 con 0x7fe670096e70 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 -- 172.21.15.46:0/1157019323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670096e70 msgr2=0x7fe6700abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670096e70 0x7fe6700abfb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe670064600 tx=0x7fe6600091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 -- 172.21.15.46:0/1157019323 shutdown_connections 2024-08-17T02:30:52.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 --2- 172.21.15.46:0/1157019323 >> v2:172.21.15.162:3300/0 conn(0x7fe670067de0 0x7fe670068200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670096e70 0x7fe6700abfb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 --2- 172.21.15.46:0/1157019323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670069230 0x7fe670069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 -- 172.21.15.46:0/1157019323 >> 172.21.15.46:0/1157019323 conn(0x7fe670096a70 msgr2=0x7fe6700cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 -- 172.21.15.46:0/1157019323 shutdown_connections 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.871+0000 7fe677200640 1 -- 172.21.15.46:0/1157019323 wait complete. 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.872+0000 7fe677200640 1 Processor -- start 2024-08-17T02:30:52.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.872+0000 7fe677200640 1 -- start start 2024-08-17T02:30:52.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe670069230 0x7fe670097ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 0x7fe670169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700994e0 con 0x7fe670067de0 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700b2ff0 con 0x7fe670069230 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe677200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700b2750 con 0x7fe670096e70 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.873+0000 7fe675e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39256/0 (socket says 172.21.15.46:39256) 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 -- 172.21.15.46:0/3308942288 learned_addr learned my addr 172.21.15.46:0/3308942288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675400640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe670069230 0x7fe670097ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe676800640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 0x7fe670169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 -- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 msgr2=0x7fe670169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 0x7fe670169060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 -- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe670069230 msgr2=0x7fe670097ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe670069230 0x7fe670097ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 -- 172.21.15.46:0/3308942288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe660009450 con 0x7fe670067de0 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe676800640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 0x7fe670169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:52.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe675e00640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe66400d890 tx=0x7fe664008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400de20 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6640098b0 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.874+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6700b2a30 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.875+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664009c50 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.875+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe670099770 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.876+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe670071050 con 0x7fe670067de0 2024-08-17T02:30:52.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.876+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe664014620 con 0x7fe670067de0 2024-08-17T02:30:52.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.877+0000 7fe669600640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 0x7fe654067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:52.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.877+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fe664082c70 con 0x7fe670067de0 2024-08-17T02:30:52.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.878+0000 7fe675400640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 0x7fe654067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:52.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.879+0000 7fe675400640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 0x7fe654067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe660032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:52.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:52.882+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe664050cb0 con 0x7fe670067de0 2024-08-17T02:30:53.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.060+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.data", "var": "pg_num"} v 0) v1 -- 0x7fe6700cd5e0 con 0x7fe670067de0 2024-08-17T02:30:53.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.061+0000 7fe669600640 1 -- 172.21.15.46:0/3308942288 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000237964.data", "var": "pg_num"}]=0 v39) v1 ==== 124+0+11 (secure 0 0 0) 0x7fe6640542d0 con 0x7fe670067de0 2024-08-17T02:30:53.062 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-08-17T02:30:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 msgr2=0x7fe654067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 0x7fe654067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe660034000 tx=0x7fe660032000 comp rx=0 tx=0).stop 2024-08-17T02:30:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 msgr2=0x7fe6700b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe66400d890 tx=0x7fe664008040 comp rx=0 tx=0).stop 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 shutdown_connections 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fe654065150 0x7fe654067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe670096e70 0x7fe670169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe670069230 0x7fe670097ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 --2- 172.21.15.46:0/3308942288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe670067de0 0x7fe6700b2060 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 >> 172.21.15.46:0/3308942288 conn(0x7fe670096a70 msgr2=0x7fe67006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 shutdown_connections 2024-08-17T02:30:53.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.063+0000 7fe677200640 1 -- 172.21.15.46:0/3308942288 wait complete. 2024-08-17T02:30:53.080 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:53.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.230+0000 7f3194e00640 1 Processor -- start 2024-08-17T02:30:53.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.231+0000 7f3194e00640 1 -- start start 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f3194e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3190069170 0x7f31900695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f3194e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3190069b00 con 0x7f319015c8d0 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f3194e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319006d0b0 con 0x7f3190068510 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f3194e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900688e0 con 0x7f3190069170 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f318ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3190069170 0x7f31900695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f318ea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3190069170 0x7f31900695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39262/0 (socket says 172.21.15.46:39262) 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f318ea00640 1 -- 172.21.15.46:0/3336248767 learned_addr learned my addr 172.21.15.46:0/3336248767 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:53.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.232+0000 7f318fe00640 1 --1- 172.21.15.46:0/3336248767 >> v1:172.21.15.46:6789/0 conn(0x7f319015c8d0 0x7f319015ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43390/0 (socket says 172.21.15.46:43390) 2024-08-17T02:30:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.233+0000 7f318ea00640 1 -- 172.21.15.46:0/3336248767 >> v1:172.21.15.162:6789/0 conn(0x7f3190068510 legacy=0x7f319006de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.233+0000 7f318ea00640 1 -- 172.21.15.46:0/3336248767 >> v1:172.21.15.46:6789/0 conn(0x7f319015c8d0 legacy=0x7f319015ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.233+0000 7f318ea00640 1 -- 172.21.15.46:0/3336248767 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319015d5c0 con 0x7f3190069170 2024-08-17T02:30:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.233+0000 7f318e000640 1 -- 172.21.15.46:0/3336248767 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505518132 0 0) 0x7f3190069b00 con 0x7f319015c8d0 2024-08-17T02:30:53.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f318ea00640 1 --2- 172.21.15.46:0/3336248767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3190069170 0x7f31900695c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f317c009910 tx=0x7f317c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b2376461dee715 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f318e000640 1 -- 172.21.15.46:0/3336248767 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c032440 con 0x7f3190069170 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f318e000640 1 -- 172.21.15.46:0/3336248767 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c0325a0 con 0x7f3190069170 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f318e000640 1 -- 172.21.15.46:0/3336248767 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c032940 con 0x7f3190069170 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f3194e00640 1 -- 172.21.15.46:0/3336248767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3190069170 msgr2=0x7f31900695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.234+0000 7f3194e00640 1 --2- 172.21.15.46:0/3336248767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3190069170 0x7f31900695c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f317c009910 tx=0x7f317c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.235+0000 7f3194e00640 1 -- 172.21.15.46:0/3336248767 shutdown_connections 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.235+0000 7f3194e00640 1 --2- 172.21.15.46:0/3336248767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3190069170 0x7f31900695c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.235+0000 7f3194e00640 1 -- 172.21.15.46:0/3336248767 >> 172.21.15.46:0/3336248767 conn(0x7f31900cc040 msgr2=0x7f31900cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.235+0000 7f3194e00640 1 -- 172.21.15.46:0/3336248767 shutdown_connections 2024-08-17T02:30:53.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.235+0000 7f3194e00640 1 -- 172.21.15.46:0/3336248767 wait complete. 2024-08-17T02:30:53.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.236+0000 7f3194e00640 1 Processor -- start 2024-08-17T02:30:53.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.236+0000 7f3194e00640 1 -- start start 2024-08-17T02:30:53.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3190068510 0x7f31900ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3190069170 0x7f31900cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319006e540 con 0x7f319015c8d0 2024-08-17T02:30:53.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015d8a0 con 0x7f3190068510 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f3194e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900ae4b0 con 0x7f3190069170 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f318fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f318fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39264/0 (socket says 172.21.15.46:39264) 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f318fe00640 1 -- 172.21.15.46:0/2673620095 learned_addr learned my addr 172.21.15.46:0/2673620095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.237+0000 7f318f400640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3190068510 0x7f31900ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318ea00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3190069170 0x7f31900cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 -- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3190069170 msgr2=0x7f31900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3190069170 0x7f31900cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 -- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3190068510 msgr2=0x7f31900ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3190068510 0x7f31900ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 -- 172.21.15.46:0/2673620095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c009450 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f318fe00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f318800c860 tx=0x7f31880015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.238+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800ce50 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.239+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188005d60 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.239+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800a870 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.239+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31900ad5d0 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.239+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31900adb80 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.240+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31900ae5f0 con 0x7f319015c8d0 2024-08-17T02:30:53.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.240+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f318800ac60 con 0x7f319015c8d0 2024-08-17T02:30:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.241+0000 7f3186a00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 0x7f3170067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.241+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3188082140 con 0x7f319015c8d0 2024-08-17T02:30:53.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.242+0000 7f318f400640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 0x7f3170067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.243+0000 7f318f400640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 0x7f3170067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3180007fd0 tx=0x7f3180007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.245+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31900ae5f0 con 0x7f319015c8d0 2024-08-17T02:30:53.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.468+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31900ae5f0 con 0x7f319015c8d0 2024-08-17T02:30:53.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.468+0000 7f3186a00640 1 -- 172.21.15.46:0/2673620095 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f31900ae5f0 con 0x7f319015c8d0 2024-08-17T02:30:53.469 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:53.469 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2491802042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2491802042},{"type":"v1","addr":"172.21.15.46:6835","nonce":2491802042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:53.470 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 msgr2=0x7f3170067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 0x7f3170067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3180007fd0 tx=0x7f3180007e30 comp rx=0 tx=0).stop 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 msgr2=0x7f31900cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f318800c860 tx=0x7f31880015f0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 shutdown_connections 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f319015c8d0 0x7f31900cc950 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3170065150 0x7f3170067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3190069170 0x7f31900cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 --2- 172.21.15.46:0/2673620095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3190068510 0x7f31900ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 >> 172.21.15.46:0/2673620095 conn(0x7f31900cc040 msgr2=0x7f3190156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 shutdown_connections 2024-08-17T02:30:53.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.471+0000 7f3194e00640 1 -- 172.21.15.46:0/2673620095 wait complete. 2024-08-17T02:30:53.487 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.638+0000 7fef85400640 1 Processor -- start 2024-08-17T02:30:53.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.638+0000 7fef85400640 1 -- start start 2024-08-17T02:30:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef85400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef800aa7d0 0x7fef8006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef85400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef80158fa0 0x7fef800ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef85400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800a9a10 con 0x7fef8006da20 2024-08-17T02:30:53.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef85400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800ac400 con 0x7fef800aa7d0 2024-08-17T02:30:53.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef85400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800a9cf0 con 0x7fef80158fa0 2024-08-17T02:30:53.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef7e800640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fef8006da20 0x7fef80158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43394/0 (socket says 172.21.15.46:43394) 2024-08-17T02:30:53.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef7de00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fef800aa7d0 0x7fef8006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.639+0000 7fef7e800640 1 -- 172.21.15.46:0/2855293254 learned_addr learned my addr 172.21.15.46:0/2855293254 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.640+0000 7fef7de00640 1 -- 172.21.15.46:0/2855293254 >> v2:172.21.15.162:3300/0 conn(0x7fef80158fa0 msgr2=0x7fef800ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.640+0000 7fef7de00640 1 --2- 172.21.15.46:0/2855293254 >> v2:172.21.15.162:3300/0 conn(0x7fef80158fa0 0x7fef800ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.640+0000 7fef7de00640 1 -- 172.21.15.46:0/2855293254 >> v1:172.21.15.46:6789/0 conn(0x7fef8006da20 legacy=0x7fef80158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.640+0000 7fef7de00640 1 -- 172.21.15.46:0/2855293254 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800a9fd0 con 0x7fef800aa7d0 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.641+0000 7fef7de00640 1 --2- 172.21.15.46:0/2855293254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8006ddf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fef800ad2e0 tx=0x7fef6c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37ffa35600a7947 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.641+0000 7fef7d400640 1 -- 172.21.15.46:0/2855293254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c02ad20 con 0x7fef800aa7d0 2024-08-17T02:30:53.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.641+0000 7fef7d400640 1 -- 172.21.15.46:0/2855293254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c02ae80 con 0x7fef800aa7d0 2024-08-17T02:30:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.641+0000 7fef7d400640 1 -- 172.21.15.46:0/2855293254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c032670 con 0x7fef800aa7d0 2024-08-17T02:30:53.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 -- 172.21.15.46:0/2855293254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 msgr2=0x7fef8006ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 --2- 172.21.15.46:0/2855293254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8006ddf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fef800ad2e0 tx=0x7fef6c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 -- 172.21.15.46:0/2855293254 shutdown_connections 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 --2- 172.21.15.46:0/2855293254 >> v2:172.21.15.162:3300/0 conn(0x7fef80158fa0 0x7fef800ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 --2- 172.21.15.46:0/2855293254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8006ddf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 -- 172.21.15.46:0/2855293254 >> 172.21.15.46:0/2855293254 conn(0x7fef800cb9b0 msgr2=0x7fef800cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 -- 172.21.15.46:0/2855293254 shutdown_connections 2024-08-17T02:30:53.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.642+0000 7fef85400640 1 -- 172.21.15.46:0/2855293254 wait complete. 2024-08-17T02:30:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.643+0000 7fef85400640 1 Processor -- start 2024-08-17T02:30:53.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.643+0000 7fef85400640 1 -- start start 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef8006da20 0x7fef80152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 0x7fef8014a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80159b10 con 0x7fef800aa7d0 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800ca610 con 0x7fef8006da20 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.644+0000 7fef85400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef80157020 con 0x7fef80158fa0 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39274/0 (socket says 172.21.15.46:39274) 2024-08-17T02:30:53.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 -- 172.21.15.46:0/3733571626 learned_addr learned my addr 172.21.15.46:0/3733571626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7e800640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef8006da20 0x7fef80152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7f200640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 0x7fef8014a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 -- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 msgr2=0x7fef8014a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 0x7fef8014a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 -- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef8006da20 msgr2=0x7fef80152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef8006da20 0x7fef80152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7de00640 1 -- 172.21.15.46:0/3733571626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c009390 con 0x7fef800aa7d0 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.645+0000 7fef7f200640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 0x7fef8014a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef7de00640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009360 tx=0x7fef6c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c032e20 con 0x7fef800aa7d0 2024-08-17T02:30:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c031a60 con 0x7fef800aa7d0 2024-08-17T02:30:53.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c031e20 con 0x7fef800aa7d0 2024-08-17T02:30:53.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef80156260 con 0x7fef800aa7d0 2024-08-17T02:30:53.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.646+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef80156820 con 0x7fef800aa7d0 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.647+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80064db0 con 0x7fef800aa7d0 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.648+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fef6c043030 con 0x7fef800aa7d0 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.648+0000 7fef76000640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 0x7fef60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.649+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fef6c041070 con 0x7fef800aa7d0 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.649+0000 7fef7e800640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 0x7fef60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:53.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.650+0000 7fef7e800640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 0x7fef60067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef70007880 tx=0x7fef70007e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.652+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fef6c070af0 con 0x7fef800aa7d0 2024-08-17T02:30:53.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.835+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef80154590 con 0x7fef800aa7d0 2024-08-17T02:30:53.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.835+0000 7fef76000640 1 -- 172.21.15.46:0/3733571626 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15512 (secure 0 0 0) 0x7fef6c04b090 con 0x7fef800aa7d0 2024-08-17T02:30:53.841 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:53.841 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:30:51.569091+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6835/1370984622":"2024-08-18T02:30:48.559373+0000","172.21.15.46:6834/1370984622":"2024-08-18T02:30:48.559373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 msgr2=0x7fef60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 0x7fef60067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef70007880 tx=0x7fef70007e20 comp rx=0 tx=0).stop 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 msgr2=0x7fef8014a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009360 tx=0x7fef6c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 shutdown_connections 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fef60065150 0x7fef60067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef80158fa0 0x7fef8014a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef800aa7d0 0x7fef8014a120 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 --2- 172.21.15.46:0/3733571626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef8006da20 0x7fef80152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 >> 172.21.15.46:0/3733571626 conn(0x7fef800cb9b0 msgr2=0x7fef80158660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 shutdown_connections 2024-08-17T02:30:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:53.838+0000 7fef85400640 1 -- 172.21.15.46:0/3733571626 wait complete. 2024-08-17T02:30:53.854 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000237964 and related pools 2024-08-17T02:30:53.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:54.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.005+0000 7f3a28200640 1 Processor -- start 2024-08-17T02:30:54.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.005+0000 7f3a28200640 1 -- start start 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a28200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a28200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f3a200b1440 0x7f3a200c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a28200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a200caa80 con 0x7f3a20140580 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a28200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a200cb450 con 0x7f3a200b1440 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a28200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200c9e70 con 0x7f3a201401b0 2024-08-17T02:30:54.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a24e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3a20140580 0x7f3a200b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43400/0 (socket says 172.21.15.46:43400) 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a24e00640 1 -- 172.21.15.46:0/4218716007 learned_addr learned my addr 172.21.15.46:0/4218716007 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a26200640 1 --2- 172.21.15.46:0/4218716007 >> v2:172.21.15.46:3300/0 conn(0x7f3a200b1440 0x7f3a200c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a25800640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a1fe00640 1 -- 172.21.15.46:0/4218716007 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928326225 0 0) 0x7f3a200caa80 con 0x7f3a20140580 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a26200640 1 -- 172.21.15.46:0/4218716007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 msgr2=0x7f3a200caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.007+0000 7f3a26200640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.008+0000 7f3a26200640 1 -- 172.21.15.46:0/4218716007 >> v1:172.21.15.46:6789/0 conn(0x7f3a20140580 legacy=0x7f3a200b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.008+0000 7f3a26200640 1 -- 172.21.15.46:0/4218716007 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200ca150 con 0x7f3a200b1440 2024-08-17T02:30:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a26200640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a200c9040 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009e60 tx=0x7f3a18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d06eb582e99630 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a1fe00640 1 -- 172.21.15.46:0/4218716007 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18007550 con 0x7f3a200b1440 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a1fe00640 1 -- 172.21.15.46:0/4218716007 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1802d050 con 0x7f3a200b1440 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a1fe00640 1 -- 172.21.15.46:0/4218716007 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a180078e0 con 0x7f3a200b1440 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a28200640 1 -- 172.21.15.46:0/4218716007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 msgr2=0x7f3a200c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a28200640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a200c9040 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009e60 tx=0x7f3a18009780 comp rx=0 tx=0).stop 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a28200640 1 -- 172.21.15.46:0/4218716007 shutdown_connections 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a28200640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a200c9040 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.009+0000 7f3a28200640 1 --2- 172.21.15.46:0/4218716007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.010+0000 7f3a28200640 1 -- 172.21.15.46:0/4218716007 >> 172.21.15.46:0/4218716007 conn(0x7f3a200cb9b0 msgr2=0x7f3a200cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.010+0000 7f3a28200640 1 -- 172.21.15.46:0/4218716007 shutdown_connections 2024-08-17T02:30:54.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.010+0000 7f3a28200640 1 -- 172.21.15.46:0/4218716007 wait complete. 2024-08-17T02:30:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.011+0000 7f3a28200640 1 Processor -- start 2024-08-17T02:30:54.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.011+0000 7f3a28200640 1 -- start start 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 0x7f3a2013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b0500 con 0x7f3a200b1440 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200af460 con 0x7f3a20140580 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a28200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200af740 con 0x7f3a201401b0 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a25800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a25800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39284/0 (socket says 172.21.15.46:39284) 2024-08-17T02:30:54.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.012+0000 7f3a25800640 1 -- 172.21.15.46:0/1603132810 learned_addr learned my addr 172.21.15.46:0/1603132810 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a26200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 0x7f3a2013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a24e00640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 -- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 msgr2=0x7f3a200aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 -- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 msgr2=0x7f3a2013cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 0x7f3a2013cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 -- 172.21.15.46:0/1603132810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18009a20 con 0x7f3a200b1440 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a26200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 0x7f3a2013cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a24e00640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a25800640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400ea50 tx=0x7f3a140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400ca10 con 0x7f3a200b1440 2024-08-17T02:30:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1400cb70 con 0x7f3a200b1440 2024-08-17T02:30:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14013470 con 0x7f3a200b1440 2024-08-17T02:30:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a200afa20 con 0x7f3a200b1440 2024-08-17T02:30:54.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.013+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a200affe0 con 0x7f3a200b1440 2024-08-17T02:30:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.015+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a200b0200 con 0x7f3a200b1440 2024-08-17T02:30:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.015+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a14013820 con 0x7f3a200b1440 2024-08-17T02:30:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.016+0000 7f3a1cc00640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 0x7f3a00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.016+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3a14082a90 con 0x7f3a200b1440 2024-08-17T02:30:54.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.017+0000 7f3a24e00640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 0x7f3a00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.017+0000 7f3a24e00640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 0x7f3a00067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a20166630 tx=0x7f3a0c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.020+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3a14050af0 con 0x7f3a200b1440 2024-08-17T02:30:54.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.239+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a20064db0 con 0x7f3a200b1440 2024-08-17T02:30:54.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.240+0000 7f3a1cc00640 1 -- 172.21.15.46:0/1603132810 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f3a14054110 con 0x7f3a200b1440 2024-08-17T02:30:54.241 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:54.241 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2491802042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2491802042},{"type":"v1","addr":"172.21.15.46:6835","nonce":2491802042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:54.241 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-08-17T02:30:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 msgr2=0x7f3a00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 0x7f3a00067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3a20166630 tx=0x7f3a0c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:54.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 msgr2=0x7f3a201696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400ea50 tx=0x7f3a140090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 shutdown_connections 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a20140580 0x7f3a2013cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f3a00065150 0x7f3a00067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a201401b0 0x7f3a200aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 --2- 172.21.15.46:0/1603132810 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a200b1440 0x7f3a201696a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.242+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 >> 172.21.15.46:0/1603132810 conn(0x7f3a200cb9b0 msgr2=0x7f3a200c7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.243+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 shutdown_connections 2024-08-17T02:30:54.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.243+0000 7f3a28200640 1 -- 172.21.15.46:0/1603132810 wait complete. 2024-08-17T02:30:54.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:54.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.408+0000 7f9035600640 1 Processor -- start 2024-08-17T02:30:54.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.408+0000 7f9035600640 1 -- start start 2024-08-17T02:30:54.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.409+0000 7f9035600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9030155a20 0x7f90300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.409+0000 7f9035600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.409+0000 7f9035600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9030156670 con 0x7f903006d7f0 2024-08-17T02:30:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f9035600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90300b0350 con 0x7f9030155a20 2024-08-17T02:30:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f9035600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903006e5e0 con 0x7f9030155df0 2024-08-17T02:30:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f902ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9030155a20 0x7f90300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f9026000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f902f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f903006d7f0 0x7f90300ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:37584/0 (socket says 172.21.15.46:37584) 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.410+0000 7f902f400640 1 -- 172.21.15.46:0/2615136726 learned_addr learned my addr 172.21.15.46:0/2615136726 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.411+0000 7f902ea00640 1 -- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 msgr2=0x7f90300ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.411+0000 7f902ea00640 1 --2- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.411+0000 7f902ea00640 1 -- 172.21.15.46:0/2615136726 >> v1:172.21.15.162:6789/0 conn(0x7f903006d7f0 legacy=0x7f90300ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.411+0000 7f902ea00640 1 -- 172.21.15.46:0/2615136726 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903006e8c0 con 0x7f9030155a20 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.411+0000 7f902e000640 1 -- 172.21.15.46:0/2615136726 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273548321 0 0) 0x7f9030156670 con 0x7f903006d7f0 2024-08-17T02:30:54.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.412+0000 7f902ea00640 1 --2- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9030155a20 0x7f90300adf10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9020009850 tx=0x7f90200090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dfd6ad1b8ec723f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.412+0000 7f902e000640 1 -- 172.21.15.46:0/2615136726 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902002ad90 con 0x7f9030155a20 2024-08-17T02:30:54.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.412+0000 7f902e000640 1 -- 172.21.15.46:0/2615136726 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020032440 con 0x7f9030155a20 2024-08-17T02:30:54.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.412+0000 7f902e000640 1 -- 172.21.15.46:0/2615136726 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90200327e0 con 0x7f9030155a20 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 -- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9030155a20 msgr2=0x7f90300adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 --2- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9030155a20 0x7f90300adf10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9020009850 tx=0x7f90200090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 -- 172.21.15.46:0/2615136726 shutdown_connections 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 --2- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 --2- 172.21.15.46:0/2615136726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9030155a20 0x7f90300adf10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 -- 172.21.15.46:0/2615136726 >> 172.21.15.46:0/2615136726 conn(0x7f90300cb9b0 msgr2=0x7f90300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 -- 172.21.15.46:0/2615136726 shutdown_connections 2024-08-17T02:30:54.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.413+0000 7f9035600640 1 -- 172.21.15.46:0/2615136726 wait complete. 2024-08-17T02:30:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.414+0000 7f9035600640 1 Processor -- start 2024-08-17T02:30:54.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 -- start start 2024-08-17T02:30:54.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f903006d7f0 0x7f90300aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300a9f10 con 0x7f9030155a20 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90300a9340 con 0x7f903006d7f0 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.415+0000 7f9035600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90300cb680 con 0x7f9030155df0 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39290/0 (socket says 172.21.15.46:39290) 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 -- 172.21.15.46:0/4081486930 learned_addr learned my addr 172.21.15.46:0/4081486930 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f902ea00640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f903006d7f0 0x7f90300aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f902f400640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 -- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 msgr2=0x7f90300a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 -- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f903006d7f0 msgr2=0x7f90300aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f903006d7f0 0x7f90300aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.416+0000 7f9026000640 1 -- 172.21.15.46:0/4081486930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009390 con 0x7f9030155a20 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9026000640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f901800e900 tx=0x7f90180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800c8e0 con 0x7f9030155a20 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901800ca40 con 0x7f9030155a20 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90300a95e0 con 0x7f9030155a20 2024-08-17T02:30:54.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800cde0 con 0x7f9030155a20 2024-08-17T02:30:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.417+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90300a9ba0 con 0x7f9030155a20 2024-08-17T02:30:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.418+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90300aa0c0 con 0x7f9030155a20 2024-08-17T02:30:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.419+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9018013680 con 0x7f9030155a20 2024-08-17T02:30:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.420+0000 7f9026a00640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 0x7f900c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.420+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f90180825f0 con 0x7f9030155a20 2024-08-17T02:30:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.420+0000 7f902ea00640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 0x7f900c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.421+0000 7f902ea00640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 0x7f900c067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f9020032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.424+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f90300aa0c0 con 0x7f9030155a20 2024-08-17T02:30:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.646+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9030064db0 con 0x7f9030155a20 2024-08-17T02:30:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.646+0000 7f9026a00640 1 -- 172.21.15.46:0/4081486930 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4621 (secure 0 0 0) 0x7f90180506e0 con 0x7f9030155a20 2024-08-17T02:30:54.647 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:54.647 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2491802042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2491802042},{"type":"v1","addr":"172.21.15.46:6835","nonce":2491802042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:40.795355+0000","modified":"2024-08-17T02:28:42.794158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.46:6833/2986162154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2986162154},{"type":"v1","addr":"172.21.15.46:6833","nonce":2986162154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000237964","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:54.648 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 msgr2=0x7f900c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 0x7f900c067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9020034000 tx=0x7f9020032000 comp rx=0 tx=0).stop 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 msgr2=0x7f90300cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f901800e900 tx=0x7f90180090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 shutdown_connections 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f900c065150 0x7f900c067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9030155df0 0x7f90300a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9030155a20 0x7f90300cb140 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 --2- 172.21.15.46:0/4081486930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f903006d7f0 0x7f90300aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 >> 172.21.15.46:0/4081486930 conn(0x7f90300cb9b0 msgr2=0x7f9030153540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 shutdown_connections 2024-08-17T02:30:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.648+0000 7f9035600640 1 -- 172.21.15.46:0/4081486930 wait complete. 2024-08-17T02:30:54.664 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.814+0000 7faf72600640 1 Processor -- start 2024-08-17T02:30:54.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.815+0000 7faf72600640 1 -- start start 2024-08-17T02:30:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf72600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf6c159ca0 0x7faf6c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf72600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 0x7faf6c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf72600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6c0cadc0 con 0x7faf6c0ccad0 2024-08-17T02:30:54.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf72600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6c0cd6e0 con 0x7faf6c159ca0 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf72600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c0ccf70 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf6c159ca0 0x7faf6c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71c00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7faf6c0ccad0 0x7faf6c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43416/0 (socket says 172.21.15.46:43416) 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf6c159ca0 0x7faf6c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39304/0 (socket says 172.21.15.46:39304) 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71c00640 1 -- 172.21.15.46:0/3117742096 learned_addr learned my addr 172.21.15.46:0/3117742096 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf6be00640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 0x7faf6c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 -- 172.21.15.46:0/3117742096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 msgr2=0x7faf6c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 0x7faf6c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 -- 172.21.15.46:0/3117742096 >> v1:172.21.15.46:6789/0 conn(0x7faf6c0ccad0 legacy=0x7faf6c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf71200640 1 -- 172.21.15.46:0/3117742096 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0cb060 con 0x7faf6c159ca0 2024-08-17T02:30:54.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.816+0000 7faf6be00640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 0x7faf6c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.817+0000 7faf71200640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c159ca0 0x7faf6c0ca360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf60009850 tx=0x7faf600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782387dde8cda3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf6b400640 1 -- 172.21.15.46:0/3117742096 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6002ad90 con 0x7faf6c159ca0 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf6b400640 1 -- 172.21.15.46:0/3117742096 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60032440 con 0x7faf6c159ca0 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf6b400640 1 -- 172.21.15.46:0/3117742096 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60032820 con 0x7faf6c159ca0 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 -- 172.21.15.46:0/3117742096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c159ca0 msgr2=0x7faf6c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c159ca0 0x7faf6c0ca360 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf60009850 tx=0x7faf600090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 -- 172.21.15.46:0/3117742096 shutdown_connections 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ca8a0 0x7faf6c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 --2- 172.21.15.46:0/3117742096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c159ca0 0x7faf6c0ca360 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 -- 172.21.15.46:0/3117742096 >> 172.21.15.46:0/3117742096 conn(0x7faf6c098e00 msgr2=0x7faf6c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.818+0000 7faf72600640 1 -- 172.21.15.46:0/3117742096 shutdown_connections 2024-08-17T02:30:54.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.819+0000 7faf72600640 1 -- 172.21.15.46:0/3117742096 wait complete. 2024-08-17T02:30:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.820+0000 7faf72600640 1 Processor -- start 2024-08-17T02:30:54.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.820+0000 7faf72600640 1 -- start start 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 0x7faf6c0b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 0x7faf6c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c15d0a0 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c15d530 con 0x7faf6c159ca0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf72600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c15c490 con 0x7faf6c0ccad0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf71200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf71200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39310/0 (socket says 172.21.15.46:39310) 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf71200640 1 -- 172.21.15.46:0/3082640379 learned_addr learned my addr 172.21.15.46:0/3082640379 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf6be00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 0x7faf6c0b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.821+0000 7faf71c00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 0x7faf6c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 -- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 msgr2=0x7faf6c0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 0x7faf6c0b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 -- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 msgr2=0x7faf6c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 0x7faf6c0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 -- 172.21.15.46:0/3082640379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf60009390 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf6be00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 0x7faf6c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71c00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 0x7faf6c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf71200640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf60009360 tx=0x7faf60032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60031dc0 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60000c40 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6003d670 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c15c770 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.822+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c15cd30 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.823+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c071050 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.824+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf60039040 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.825+0000 7faf5fe00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 0x7faf4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.825+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7faf600a2470 con 0x7faf6c0ca8a0 2024-08-17T02:30:54.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.826+0000 7faf6be00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 0x7faf4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:54.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.827+0000 7faf6be00640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 0x7faf4c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf58006e70 tx=0x7faf58008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:54.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:54.829+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faf60070410 con 0x7faf6c0ca8a0 2024-08-17T02:30:55.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.012+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf6c157150 con 0x7faf6c0ca8a0 2024-08-17T02:30:55.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.013+0000 7faf5fe00640 1 -- 172.21.15.46:0/3082640379 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15512 (secure 0 0 0) 0x7faf60073a30 con 0x7faf6c0ca8a0 2024-08-17T02:30:55.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:30:55.014 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:30:51.569091+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000237964.meta","create_time":"2024-08-17T02:28:38.969348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000237964"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000237964.data","create_time":"2024-08-17T02:28:39.821358+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000237964"}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6835/1370984622":"2024-08-18T02:30:48.559373+0000","172.21.15.46:6834/1370984622":"2024-08-18T02:30:48.559373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:55.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 msgr2=0x7faf4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 0x7faf4c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faf58006e70 tx=0x7faf58008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 msgr2=0x7faf6c156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf60009360 tx=0x7faf60032000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 shutdown_connections 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf6c159ca0 0x7faf6c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faf4c065150 0x7faf4c067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf6c0ccad0 0x7faf6c0b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 --2- 172.21.15.46:0/3082640379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf6c0ca8a0 0x7faf6c156020 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 >> 172.21.15.46:0/3082640379 conn(0x7faf6c098e00 msgr2=0x7faf6c158870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 shutdown_connections 2024-08-17T02:30:55.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.015+0000 7faf72600640 1 -- 172.21.15.46:0/3082640379 wait complete. 2024-08-17T02:30:55.032 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000237964 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.184+0000 7fcbdea00640 1 Processor -- start 2024-08-17T02:30:55.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.184+0000 7fcbdea00640 1 -- start start 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdea00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcbd815c230 0x7fcbd806be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbd815c600 0x7fcbd806e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdea00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd806b9d0 con 0x7fcbd8066cd0 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdea00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80aad80 con 0x7fcbd815c230 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdea00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd80ab060 con 0x7fcbd815c600 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbd7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcbd815c230 0x7fcbd806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdca00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcbd8066cd0 0x7fcbd80670a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43420/0 (socket says 172.21.15.46:43420) 2024-08-17T02:30:55.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbdca00640 1 -- 172.21.15.46:0/1290023609 learned_addr learned my addr 172.21.15.46:0/1290023609 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.185+0000 7fcbd7e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcbd815c230 0x7fcbd806be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39314/0 (socket says 172.21.15.46:39314) 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd7400640 1 --2- 172.21.15.46:0/1290023609 >> v2:172.21.15.162:3300/0 conn(0x7fcbd815c600 0x7fcbd806e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd7e00640 1 -- 172.21.15.46:0/1290023609 >> v2:172.21.15.162:3300/0 conn(0x7fcbd815c600 msgr2=0x7fcbd806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd7e00640 1 --2- 172.21.15.46:0/1290023609 >> v2:172.21.15.162:3300/0 conn(0x7fcbd815c600 0x7fcbd806e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd7e00640 1 -- 172.21.15.46:0/1290023609 >> v1:172.21.15.46:6789/0 conn(0x7fcbd8066cd0 legacy=0x7fcbd80670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd6a00640 1 -- 172.21.15.46:0/1290023609 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529350681 0 0) 0x7fcbd806b9d0 con 0x7fcbd8066cd0 2024-08-17T02:30:55.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.186+0000 7fcbd7e00640 1 -- 172.21.15.46:0/1290023609 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd806b380 con 0x7fcbd815c230 2024-08-17T02:30:55.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.187+0000 7fcbd7e00640 1 --2- 172.21.15.46:0/1290023609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c230 0x7fcbd806be60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80693b0 tx=0x7fcbc80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb4056f5f07cbb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.187+0000 7fcbd6a00640 1 -- 172.21.15.46:0/1290023609 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc802adb0 con 0x7fcbd815c230 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.187+0000 7fcbd6a00640 1 -- 172.21.15.46:0/1290023609 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc8032440 con 0x7fcbd815c230 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.187+0000 7fcbd6a00640 1 -- 172.21.15.46:0/1290023609 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80327e0 con 0x7fcbd815c230 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 -- 172.21.15.46:0/1290023609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c230 msgr2=0x7fcbd806be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 --2- 172.21.15.46:0/1290023609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c230 0x7fcbd806be60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80693b0 tx=0x7fcbc80090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 -- 172.21.15.46:0/1290023609 shutdown_connections 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 --2- 172.21.15.46:0/1290023609 >> v2:172.21.15.162:3300/0 conn(0x7fcbd815c600 0x7fcbd806e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 --2- 172.21.15.46:0/1290023609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c230 0x7fcbd806be60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 -- 172.21.15.46:0/1290023609 >> 172.21.15.46:0/1290023609 conn(0x7fcbd806d8f0 msgr2=0x7fcbd806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 -- 172.21.15.46:0/1290023609 shutdown_connections 2024-08-17T02:30:55.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.188+0000 7fcbdea00640 1 -- 172.21.15.46:0/1290023609 wait complete. 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.189+0000 7fcbdea00640 1 Processor -- start 2024-08-17T02:30:55.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.189+0000 7fcbdea00640 1 -- start start 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd8066cd0 0x7fcbd80ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd815c230 0x7fcbd813d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd813de50 con 0x7fcbd815c600 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd80ca570 con 0x7fcbd8066cd0 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.190+0000 7fcbdea00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd8152210 con 0x7fcbd815c230 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39322/0 (socket says 172.21.15.46:39322) 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 -- 172.21.15.46:0/2494498418 learned_addr learned my addr 172.21.15.46:0/2494498418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbd7400640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd815c230 0x7fcbd813d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbd7e00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd8066cd0 0x7fcbd80ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 -- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd815c230 msgr2=0x7fcbd813d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd815c230 0x7fcbd813d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 -- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd8066cd0 msgr2=0x7fcbd80ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd8066cd0 0x7fcbd80ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 -- 172.21.15.46:0/2494498418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009390 con 0x7fcbd815c600 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.191+0000 7fcbdca00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000cc90 tx=0x7fcbd0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.192+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000a850 con 0x7fcbd815c600 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.192+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd000a9b0 con 0x7fcbd815c600 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.192+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000ad70 con 0x7fcbd815c600 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.192+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd80c9c40 con 0x7fcbd815c600 2024-08-17T02:30:55.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.192+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd80ca200 con 0x7fcbd815c600 2024-08-17T02:30:55.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.193+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd80ca700 con 0x7fcbd815c600 2024-08-17T02:30:55.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.194+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcbd0007300 con 0x7fcbd815c600 2024-08-17T02:30:55.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.194+0000 7fcbcf400640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 0x7fcbb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.194+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fcbd00825c0 con 0x7fcbd815c600 2024-08-17T02:30:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.195+0000 7fcbd7e00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 0x7fcbb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.196+0000 7fcbd7e00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 0x7fcbb8067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8034000 tx=0x7fcbc8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.198+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcbd0050690 con 0x7fcbd815c600 2024-08-17T02:30:55.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.418+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000237964"} v 0) v1 -- 0x7fcbd8064db0 con 0x7fcbd815c600 2024-08-17T02:30:55.419 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-08-17T02:30:55.418+0000 7f11b8200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:30:55.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.423+0000 7fcbcf400640 1 -- 172.21.15.46:0/2494498418 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000237964"}]=0 volume_0000000000237964 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7fcbd0053cb0 con 0x7fcbd815c600 2024-08-17T02:30:55.423 INFO:teuthology.orchestra.run.smithi046.stderr:volume_0000000000237964 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.425+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 msgr2=0x7fcbb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.425+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 0x7fcbb8067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8034000 tx=0x7fcbc8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.425+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 msgr2=0x7fcbd813d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.425+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000cc90 tx=0x7fcbd0001a80 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 shutdown_connections 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbd815c600 0x7fcbd813d910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fcbb8065150 0x7fcbb8067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbd815c230 0x7fcbd813d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 --2- 172.21.15.46:0/2494498418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbd8066cd0 0x7fcbd80ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 >> 172.21.15.46:0/2494498418 conn(0x7fcbd806d8f0 msgr2=0x7fcbd806aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 shutdown_connections 2024-08-17T02:30:55.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.426+0000 7fcbdea00640 1 -- 172.21.15.46:0/2494498418 wait complete. 2024-08-17T02:30:55.430 INFO:tasks.ceph.mds.a.smithi046.stderr: -3103> 2024-08-17T02:28:46.605+0000 7f63ca200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:55.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000237964 --yes-i-really-mean-it 2024-08-17T02:30:55.472 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-08-17T02:30:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.595+0000 7f1e3be00640 1 Processor -- start 2024-08-17T02:30:55.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.596+0000 7f1e3be00640 1 -- start start 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e3c158dd0 0x7f1e3c0abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 0x7f1e3c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3be00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c0ae330 con 0x7f1e3c069540 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3be00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c0699c0 con 0x7f1e3c158dd0 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0aca50 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3b400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1e3c069540 0x7f1e3c067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43444/0 (socket says 172.21.15.46:43444) 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3b400640 1 -- 172.21.15.46:0/2487799959 learned_addr learned my addr 172.21.15.46:0/2487799959 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:55.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3a000640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 0x7f1e3c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.597+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/2487799959 >> v2:172.21.15.162:3300/0 conn(0x7f1e3c158dd0 0x7f1e3c0abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e39600640 1 -- 172.21.15.46:0/2487799959 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099806038 0 0) 0x7f1e3c0ae330 con 0x7f1e3c069540 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e39600640 1 -- 172.21.15.46:0/2487799959 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e200034e0 con 0x7f1e3c069540 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e3aa00640 1 -- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 msgr2=0x7f1e3c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 0x7f1e3c069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e3aa00640 1 -- 172.21.15.46:0/2487799959 >> v1:172.21.15.46:6789/0 conn(0x7f1e3c069540 legacy=0x7f1e3c067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e3aa00640 1 -- 172.21.15.46:0/2487799959 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0acd30 con 0x7f1e3c158dd0 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.598+0000 7f1e3a000640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 0x7f1e3c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:55.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.599+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0abfb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009850 tx=0x7f1e2c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb00cefe982b71c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.599+0000 7f1e39600640 1 -- 172.21.15.46:0/2487799959 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c02ad80 con 0x7f1e3c158dd0 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.599+0000 7f1e39600640 1 -- 172.21.15.46:0/2487799959 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c032440 con 0x7f1e3c158dd0 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.599+0000 7f1e39600640 1 -- 172.21.15.46:0/2487799959 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c032800 con 0x7f1e3c158dd0 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 -- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 msgr2=0x7f1e3c0abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0abfb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009850 tx=0x7f1e2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 -- 172.21.15.46:0/2487799959 shutdown_connections 2024-08-17T02:30:55.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c0ac4f0 0x7f1e3c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 --2- 172.21.15.46:0/2487799959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0abfb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 -- 172.21.15.46:0/2487799959 >> 172.21.15.46:0/2487799959 conn(0x7f1e3c096a70 msgr2=0x7f1e3c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 -- 172.21.15.46:0/2487799959 shutdown_connections 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.600+0000 7f1e3be00640 1 -- 172.21.15.46:0/2487799959 wait complete. 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.601+0000 7f1e3be00640 1 Processor -- start 2024-08-17T02:30:55.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 -- start start 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c069540 0x7f1e3c0b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c09a2d0 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c09a5b0 con 0x7f1e3c158dd0 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.602+0000 7f1e3be00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c09a890 con 0x7f1e3c069540 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39346/0 (socket says 172.21.15.46:39346) 2024-08-17T02:30:55.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 -- 172.21.15.46:0/1190917488 learned_addr learned my addr 172.21.15.46:0/1190917488 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3b400640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c069540 0x7f1e3c0b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 -- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c069540 msgr2=0x7f1e3c0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c069540 0x7f1e3c0b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 -- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 msgr2=0x7f1e3c0aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.603+0000 7f1e3a000640 1 -- 172.21.15.46:0/1190917488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009390 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e3a000640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800ec80 tx=0x7f1e280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800eec0 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800cbc0 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28013470 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c009390 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.604+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0b3410 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.605+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c071050 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.606+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e280137e0 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.607+0000 7f1e32000640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 0x7f1e1c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.607+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f1e28082870 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.607+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 0x7f1e1c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.608+0000 7f1e3aa00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 0x7f1e1c067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.611+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e28050860 con 0x7f1e3c0ac4f0 2024-08-17T02:30:55.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:55.832+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000237964", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e3c0ce850 con 0x7f1e3c0ac4f0 2024-08-17T02:30:56.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.424+0000 7f1e32000640 1 -- 172.21.15.46:0/1190917488 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000237964", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1e28053e80 con 0x7f1e3c0ac4f0 2024-08-17T02:30:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 msgr2=0x7f1e1c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 0x7f1e1c067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 msgr2=0x7f1e3c0aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800ec80 tx=0x7f1e280090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 shutdown_connections 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e3c158dd0 0x7f1e3c0aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e3c0ac4f0 0x7f1e3c0aa800 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1e1c065180 0x7f1e1c067630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 --2- 172.21.15.46:0/1190917488 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e3c069540 0x7f1e3c0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.427+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 >> 172.21.15.46:0/1190917488 conn(0x7f1e3c096a70 msgr2=0x7f1e3c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.428+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 shutdown_connections 2024-08-17T02:30:56.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.428+0000 7f1e3be00640 1 -- 172.21.15.46:0/1190917488 wait complete. 2024-08-17T02:30:56.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000237964.meta cephfs.volume_0000000000237964.meta --yes-i-really-really-mean-it 2024-08-17T02:30:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.649+0000 7f5a74e00640 1 Processor -- start 2024-08-17T02:30:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.649+0000 7f5a74e00640 1 -- start start 2024-08-17T02:30:56.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.650+0000 7f5a74e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a70156890 0x7f5a7006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.650+0000 7f5a74e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a700c8840 0x7f5a7006e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.650+0000 7f5a74e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700ae9b0 con 0x7f5a70156c60 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.650+0000 7f5a74e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700aa730 con 0x7f5a700c8840 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.650+0000 7f5a74e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700aa9f0 con 0x7f5a70156890 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a700c8840 0x7f5a7006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5a700c8840 0x7f5a7006e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39348/0 (socket says 172.21.15.46:39348) 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 -- 172.21.15.46:0/2609832668 learned_addr learned my addr 172.21.15.46:0/2609832668 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:56.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6de00640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a70156890 0x7f5a7006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 -- 172.21.15.46:0/2609832668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a70156890 msgr2=0x7f5a7006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a70156890 0x7f5a7006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 -- 172.21.15.46:0/2609832668 >> v1:172.21.15.46:6789/0 conn(0x7f5a70156c60 legacy=0x7f5a700c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.651+0000 7f5a6e800640 1 -- 172.21.15.46:0/2609832668 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700ab320 con 0x7f5a700c8840 2024-08-17T02:30:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.652+0000 7f5a6e800640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a700c8840 0x7f5a7006e420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009f20 tx=0x7f5a68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e2a9e1a475848c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.652+0000 7f5a6ca00640 1 -- 172.21.15.46:0/2609832668 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68031400 con 0x7f5a700c8840 2024-08-17T02:30:56.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.652+0000 7f5a6ca00640 1 -- 172.21.15.46:0/2609832668 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6802d050 con 0x7f5a700c8840 2024-08-17T02:30:56.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.652+0000 7f5a6ca00640 1 -- 172.21.15.46:0/2609832668 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680317d0 con 0x7f5a700c8840 2024-08-17T02:30:56.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 -- 172.21.15.46:0/2609832668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a700c8840 msgr2=0x7f5a7006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a700c8840 0x7f5a7006e420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009f20 tx=0x7f5a68009840 comp rx=0 tx=0).stop 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 -- 172.21.15.46:0/2609832668 shutdown_connections 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a700c8840 0x7f5a7006e420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 --2- 172.21.15.46:0/2609832668 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a70156890 0x7f5a7006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 -- 172.21.15.46:0/2609832668 >> 172.21.15.46:0/2609832668 conn(0x7f5a70067750 msgr2=0x7f5a7006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 -- 172.21.15.46:0/2609832668 shutdown_connections 2024-08-17T02:30:56.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.653+0000 7f5a74e00640 1 -- 172.21.15.46:0/2609832668 wait complete. 2024-08-17T02:30:56.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.655+0000 7f5a74e00640 1 Processor -- start 2024-08-17T02:30:56.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.655+0000 7f5a74e00640 1 -- start start 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a700c8840 0x7f5a700ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a70156c60 0x7f5a7015b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7016a0d0 con 0x7f5a70156890 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701691f0 con 0x7f5a70156c60 2024-08-17T02:30:56.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a74e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701694c0 con 0x7f5a700c8840 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39356/0 (socket says 172.21.15.46:39356) 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 -- 172.21.15.46:0/1670637927 learned_addr learned my addr 172.21.15.46:0/1670637927 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6de00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a700c8840 0x7f5a700ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6e800640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a70156c60 0x7f5a7015b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 -- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a700c8840 msgr2=0x7f5a700ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a700c8840 0x7f5a700ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 -- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a70156c60 msgr2=0x7f5a7015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a70156c60 0x7f5a7015b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.656+0000 7f5a6d400640 1 -- 172.21.15.46:0/1670637927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009ae0 con 0x7f5a70156890 2024-08-17T02:30:56.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a6d400640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c4c0 tx=0x7f5a5c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c011590 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c011710 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c011ad0 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a701697a0 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.657+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a70169d60 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.658+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a700710c0 con 0x7f5a70156890 2024-08-17T02:30:56.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.659+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5a5c01b3b0 con 0x7f5a70156890 2024-08-17T02:30:56.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.660+0000 7f5a65600640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 0x7f5a50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.660+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f5a5c0819e0 con 0x7f5a70156890 2024-08-17T02:30:56.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.661+0000 7f5a6de00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 0x7f5a50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.661+0000 7f5a6de00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 0x7f5a50067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a60007ba0 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.664+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5a5c04f9d0 con 0x7f5a70156890 2024-08-17T02:30:56.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:56.851+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000237964.meta", "pool2": "cephfs.volume_0000000000237964.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a70068c10 con 0x7f5a70156890 2024-08-17T02:30:57.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.598+0000 7f5a65600640 1 -- 172.21.15.46:0/1670637927 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000237964.meta", "pool2": "cephfs.volume_0000000000237964.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000237964.meta' removed v41) v1 ==== 241+0+0 (secure 0 0 0) 0x7f5a5c017070 con 0x7f5a70156890 2024-08-17T02:30:57.599 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000000237964.meta' removed 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.600+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 msgr2=0x7f5a50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.600+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 0x7f5a50067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5a60007ba0 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.600+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 msgr2=0x7f5a70168cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.600+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c4c0 tx=0x7f5a5c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 shutdown_connections 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a70156c60 0x7f5a7015b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a70156890 0x7f5a70168cb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5a50065150 0x7f5a50067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 --2- 172.21.15.46:0/1670637927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a700c8840 0x7f5a700ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 >> 172.21.15.46:0/1670637927 conn(0x7f5a70067750 msgr2=0x7f5a700692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 shutdown_connections 2024-08-17T02:30:57.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.601+0000 7f5a74e00640 1 -- 172.21.15.46:0/1670637927 wait complete. 2024-08-17T02:30:57.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000237964.data cephfs.volume_0000000000237964.data --yes-i-really-really-mean-it 2024-08-17T02:30:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.775+0000 7f29faa00640 1 Processor -- start 2024-08-17T02:30:57.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.775+0000 7f29faa00640 1 -- start start 2024-08-17T02:30:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29faa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 0x7f29f40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29faa00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29f4156d40 0x7f29f406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29faa00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f406e880 con 0x7f29f406e420 2024-08-17T02:30:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29faa00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f41568b0 con 0x7f29f4156d40 2024-08-17T02:30:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29faa00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f4150500 con 0x7f29f4150130 2024-08-17T02:30:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.776+0000 7f29f3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29f4156d40 0x7f29f406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29f4156d40 0x7f29f406dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39362/0 (socket says 172.21.15.46:39362) 2024-08-17T02:30:57.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 -- 172.21.15.46:0/1338932830 learned_addr learned my addr 172.21.15.46:0/1338932830 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:57.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 -- 172.21.15.46:0/1338932830 >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 msgr2=0x7f29f40aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3e00640 1 --2- 172.21.15.46:0/1338932830 >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 0x7f29f40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 --2- 172.21.15.46:0/1338932830 >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 0x7f29f40aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 -- 172.21.15.46:0/1338932830 >> v1:172.21.15.46:6789/0 conn(0x7f29f406e420 legacy=0x7f29f40afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3400640 1 -- 172.21.15.46:0/1338932830 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4155fc0 con 0x7f29f4156d40 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.777+0000 7f29f3e00640 1 --2- 172.21.15.46:0/1338932830 >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 0x7f29f40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.778+0000 7f29f3400640 1 --2- 172.21.15.46:0/1338932830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f406dee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29f406f670 tx=0x7f29e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782ee0303a47630b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.778+0000 7f29f2a00640 1 -- 172.21.15.46:0/1338932830 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e002add0 con 0x7f29f4156d40 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.778+0000 7f29f2a00640 1 -- 172.21.15.46:0/1338932830 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0032440 con 0x7f29f4156d40 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.778+0000 7f29f2a00640 1 -- 172.21.15.46:0/1338932830 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0032820 con 0x7f29f4156d40 2024-08-17T02:30:57.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 -- 172.21.15.46:0/1338932830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 msgr2=0x7f29f406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 --2- 172.21.15.46:0/1338932830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f406dee0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29f406f670 tx=0x7f29e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 -- 172.21.15.46:0/1338932830 shutdown_connections 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 --2- 172.21.15.46:0/1338932830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f406dee0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 --2- 172.21.15.46:0/1338932830 >> v2:172.21.15.162:3300/0 conn(0x7f29f4150130 0x7f29f40aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 -- 172.21.15.46:0/1338932830 >> 172.21.15.46:0/1338932830 conn(0x7f29f4067750 msgr2=0x7f29f406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 -- 172.21.15.46:0/1338932830 shutdown_connections 2024-08-17T02:30:57.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.779+0000 7f29faa00640 1 -- 172.21.15.46:0/1338932830 wait complete. 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.780+0000 7f29faa00640 1 Processor -- start 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 -- start start 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f406e420 0x7f29f40c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f4150130 0x7f29f415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f414ccc0 con 0x7f29f4156d40 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c99d0 con 0x7f29f406e420 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.781+0000 7f29faa00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f40c9cb0 con 0x7f29f4150130 2024-08-17T02:30:57.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39364/0 (socket says 172.21.15.46:39364) 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 -- 172.21.15.46:0/2133704381 learned_addr learned my addr 172.21.15.46:0/2133704381 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f3e00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f406e420 0x7f29f40c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f3400640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f4150130 0x7f29f415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 -- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f4150130 msgr2=0x7f29f415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f4150130 0x7f29f415b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 -- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f406e420 msgr2=0x7f29f40c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f406e420 0x7f29f40c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.782+0000 7f29f8a00640 1 -- 172.21.15.46:0/2133704381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0009450 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29f8a00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00c860 tx=0x7f29ec001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00ce50 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec00a850 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00ac10 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f40c9f90 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.783+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f40c95a0 con 0x7f29f4156d40 2024-08-17T02:30:57.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.784+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f414ce30 con 0x7f29f4156d40 2024-08-17T02:30:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.785+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29ec012630 con 0x7f29f4156d40 2024-08-17T02:30:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.786+0000 7f29eb400640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 0x7f29d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.786+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f29ec082380 con 0x7f29f4156d40 2024-08-17T02:30:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.787+0000 7f29f3e00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 0x7f29d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.787+0000 7f29f3e00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 0x7f29d4067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f29e400acc0 tx=0x7f29e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.790+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29ec050550 con 0x7f29f4156d40 2024-08-17T02:30:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:57.976+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000237964.data", "pool2": "cephfs.volume_0000000000237964.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29f406e880 con 0x7f29f4156d40 2024-08-17T02:30:58.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.604+0000 7f29eb400640 1 -- 172.21.15.46:0/2133704381 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000237964.data", "pool2": "cephfs.volume_0000000000237964.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000237964.data' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f29f406e880 con 0x7f29f4156d40 2024-08-17T02:30:58.606 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs.volume_0000000000237964.data' removed 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.607+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 msgr2=0x7f29d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.607+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 0x7f29d4067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f29e400acc0 tx=0x7f29e4008040 comp rx=0 tx=0).stop 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.607+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 msgr2=0x7f29f4154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.607+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00c860 tx=0x7f29ec001690 comp rx=0 tx=0).stop 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 shutdown_connections 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29f4156d40 0x7f29f4154c70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f29d4065150 0x7f29d4067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29f4150130 0x7f29f415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 --2- 172.21.15.46:0/2133704381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29f406e420 0x7f29f40c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 >> 172.21.15.46:0/2133704381 conn(0x7f29f4067750 msgr2=0x7f29f40687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 shutdown_connections 2024-08-17T02:30:58.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.608+0000 7f29faa00640 1 -- 172.21.15.46:0/2133704381 wait complete. 2024-08-17T02:30:58.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:30:58.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.779+0000 7f8286a00640 1 Processor -- start 2024-08-17T02:30:58.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.779+0000 7f8286a00640 1 -- start start 2024-08-17T02:30:58.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.780+0000 7f8286a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 0x7f8280156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.780+0000 7f8286a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 0x7f8280155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.780+0000 7f8286a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8280158400 con 0x7f82800af580 2024-08-17T02:30:58.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.780+0000 7f8286a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82801577f0 con 0x7f8280155980 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.780+0000 7f8286a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280157ad0 con 0x7f82800a54d0 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f8284a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f82800af580 0x7f8280158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43470/0 (socket says 172.21.15.46:43470) 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f8284a00640 1 -- 172.21.15.46:0/1462489607 learned_addr learned my addr 172.21.15.46:0/1462489607 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f827f400640 1 --2- 172.21.15.46:0/1462489607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 0x7f8280155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f827fe00640 1 --2- 172.21.15.46:0/1462489607 >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 0x7f8280156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f827ea00640 1 -- 172.21.15.46:0/1462489607 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047697115 0 0) 0x7f8280158400 con 0x7f82800af580 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.781+0000 7f827ea00640 1 -- 172.21.15.46:0/1462489607 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82640034e0 con 0x7f82800af580 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.782+0000 7f827f400640 1 -- 172.21.15.46:0/1462489607 >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 msgr2=0x7f8280156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:58.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.782+0000 7f827f400640 1 --2- 172.21.15.46:0/1462489607 >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 0x7f8280156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.782+0000 7f827f400640 1 -- 172.21.15.46:0/1462489607 >> v1:172.21.15.46:6789/0 conn(0x7f82800af580 legacy=0x7f8280158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.782+0000 7f827f400640 1 -- 172.21.15.46:0/1462489607 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280157db0 con 0x7f82800a54d0 2024-08-17T02:30:58.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.782+0000 7f827fe00640 1 --2- 172.21.15.46:0/1462489607 >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 0x7f8280156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.783+0000 7f827f400640 1 --2- 172.21.15.46:0/1462489607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 0x7f8280155d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f826c009850 tx=0x7f826c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aebb7e13f3b96e34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.783+0000 7f827ea00640 1 -- 172.21.15.46:0/1462489607 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c02ad90 con 0x7f82800a54d0 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.783+0000 7f827ea00640 1 -- 172.21.15.46:0/1462489607 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c032440 con 0x7f82800a54d0 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.783+0000 7f827ea00640 1 -- 172.21.15.46:0/1462489607 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c032820 con 0x7f82800a54d0 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 -- 172.21.15.46:0/1462489607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 msgr2=0x7f8280155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 --2- 172.21.15.46:0/1462489607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 0x7f8280155d50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f826c009850 tx=0x7f826c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 -- 172.21.15.46:0/1462489607 shutdown_connections 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 --2- 172.21.15.46:0/1462489607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800a54d0 0x7f8280155d50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 --2- 172.21.15.46:0/1462489607 >> v2:172.21.15.162:3300/0 conn(0x7f8280155980 0x7f8280156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 -- 172.21.15.46:0/1462489607 >> 172.21.15.46:0/1462489607 conn(0x7f8280067750 msgr2=0x7f82800cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 -- 172.21.15.46:0/1462489607 shutdown_connections 2024-08-17T02:30:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.784+0000 7f8286a00640 1 -- 172.21.15.46:0/1462489607 wait complete. 2024-08-17T02:30:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.785+0000 7f8286a00640 1 Processor -- start 2024-08-17T02:30:58.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.785+0000 7f8286a00640 1 -- start start 2024-08-17T02:30:58.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82800a54d0 0x7f828013d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800af580 0x7f82800aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800ad650 con 0x7f8280155980 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828016a780 con 0x7f82800a54d0 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.786+0000 7f8286a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800ad090 con 0x7f82800af580 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39376/0 (socket says 172.21.15.46:39376) 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 -- 172.21.15.46:0/1940626487 learned_addr learned my addr 172.21.15.46:0/1940626487 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f827f400640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800af580 0x7f82800aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f827fe00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82800a54d0 0x7f828013d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 -- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800af580 msgr2=0x7f82800aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800af580 0x7f82800aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 -- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82800a54d0 msgr2=0x7f828013d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82800a54d0 0x7f828013d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 -- 172.21.15.46:0/1940626487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270009390 con 0x7f8280155980 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.787+0000 7f8284a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f827800cca0 tx=0x7f8278001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.788+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800a850 con 0x7f8280155980 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.788+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800a9b0 con 0x7f8280155980 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.788+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827800ad70 con 0x7f8280155980 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.788+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c009390 con 0x7f8280155980 2024-08-17T02:30:58.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.788+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828016a410 con 0x7f8280155980 2024-08-17T02:30:58.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.789+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828016a910 con 0x7f8280155980 2024-08-17T02:30:58.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.790+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8278007300 con 0x7f8280155980 2024-08-17T02:30:58.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.791+0000 7f8277400640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 0x7f8260067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.791+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8278082270 con 0x7f8280155980 2024-08-17T02:30:58.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.791+0000 7f827fe00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 0x7f8260067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.792+0000 7f827fe00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 0x7f8260067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f828014ae50 tx=0x7f82700090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.795+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8278050670 con 0x7f8280155980 2024-08-17T02:30:58.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.988+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8280071050 con 0x7f8280155980 2024-08-17T02:30:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.992+0000 7f8277400640 1 -- 172.21.15.46:0/1940626487 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8278053c90 con 0x7f8280155980 2024-08-17T02:30:58.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 msgr2=0x7f8260067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 0x7f8260067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f828014ae50 tx=0x7f82700090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 msgr2=0x7f8280153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f827800cca0 tx=0x7f8278001ae0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 shutdown_connections 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8280155980 0x7f8280153b20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f8260065150 0x7f8260067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82800af580 0x7f82800aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 --2- 172.21.15.46:0/1940626487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82800a54d0 0x7f828013d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.994+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 >> 172.21.15.46:0/1940626487 conn(0x7f8280067750 msgr2=0x7f828014b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.995+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 shutdown_connections 2024-08-17T02:30:58.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:58.995+0000 7f8286a00640 1 -- 172.21.15.46:0/1940626487 wait complete. 2024-08-17T02:30:59.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:30:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.162+0000 7fb68b200640 1 Processor -- start 2024-08-17T02:30:59.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.162+0000 7fb68b200640 1 -- start start 2024-08-17T02:30:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.163+0000 7fb68b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 0x7fb6840adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.163+0000 7fb68b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 0x7fb6840ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb68b200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb684156670 con 0x7fb68406d7f0 2024-08-17T02:30:59.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb68b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840b0350 con 0x7fb684155df0 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb68b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68406e5e0 con 0x7fb684155a20 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb689200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb68406d7f0 0x7fb6840ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:43478/0 (socket says 172.21.15.46:43478) 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb689200640 1 -- 172.21.15.46:0/3606447026 learned_addr learned my addr 172.21.15.46:0/3606447026 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb683e00640 1 --2- 172.21.15.46:0/3606447026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 0x7fb6840adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb67be00640 1 --2- 172.21.15.46:0/3606447026 >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 0x7fb6840ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb683400640 1 -- 172.21.15.46:0/3606447026 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662168715 0 0) 0x7fb684156670 con 0x7fb68406d7f0 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.164+0000 7fb683400640 1 -- 172.21.15.46:0/3606447026 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6680034e0 con 0x7fb68406d7f0 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.165+0000 7fb683e00640 1 -- 172.21.15.46:0/3606447026 >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 msgr2=0x7fb6840ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.165+0000 7fb683e00640 1 --2- 172.21.15.46:0/3606447026 >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 0x7fb6840ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.165+0000 7fb683e00640 1 -- 172.21.15.46:0/3606447026 >> v1:172.21.15.46:6789/0 conn(0x7fb68406d7f0 legacy=0x7fb6840ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.165+0000 7fb683e00640 1 -- 172.21.15.46:0/3606447026 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68406e8c0 con 0x7fb684155a20 2024-08-17T02:30:59.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.165+0000 7fb67be00640 1 --2- 172.21.15.46:0/3606447026 >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 0x7fb6840ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb683e00640 1 --2- 172.21.15.46:0/3606447026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 0x7fb6840adf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb674009850 tx=0x7fb6740090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e29e199868e19a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb683400640 1 -- 172.21.15.46:0/3606447026 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb674031510 con 0x7fb684155a20 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb683400640 1 -- 172.21.15.46:0/3606447026 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67402f050 con 0x7fb684155a20 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb683400640 1 -- 172.21.15.46:0/3606447026 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740318e0 con 0x7fb684155a20 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb68b200640 1 -- 172.21.15.46:0/3606447026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 msgr2=0x7fb6840adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.166+0000 7fb68b200640 1 --2- 172.21.15.46:0/3606447026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 0x7fb6840adf10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb674009850 tx=0x7fb6740090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 -- 172.21.15.46:0/3606447026 shutdown_connections 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 --2- 172.21.15.46:0/3606447026 >> v2:172.21.15.162:3300/0 conn(0x7fb684155df0 0x7fb6840ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 --2- 172.21.15.46:0/3606447026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155a20 0x7fb6840adf10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 -- 172.21.15.46:0/3606447026 >> 172.21.15.46:0/3606447026 conn(0x7fb6840cb9b0 msgr2=0x7fb6840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 -- 172.21.15.46:0/3606447026 shutdown_connections 2024-08-17T02:30:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.167+0000 7fb68b200640 1 -- 172.21.15.46:0/3606447026 wait complete. 2024-08-17T02:30:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.168+0000 7fb68b200640 1 Processor -- start 2024-08-17T02:30:59.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.168+0000 7fb68b200640 1 -- start start 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb68406d7f0 0x7fb684142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155df0 0x7fb68415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840ab110 con 0x7fb684155a20 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840aa220 con 0x7fb68406d7f0 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb68b200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840aa500 con 0x7fb684155df0 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb67be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb67be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39390/0 (socket says 172.21.15.46:39390) 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.169+0000 7fb67be00640 1 -- 172.21.15.46:0/1178622199 learned_addr learned my addr 172.21.15.46:0/1178622199 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb683e00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb68406d7f0 0x7fb684142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb689200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155df0 0x7fb68415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 -- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155df0 msgr2=0x7fb68415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155df0 0x7fb68415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 -- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb68406d7f0 msgr2=0x7fb684142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb68406d7f0 0x7fb684142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 -- 172.21.15.46:0/1178622199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c009390 con 0x7fb684155a20 2024-08-17T02:30:59.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67be00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00ea70 tx=0x7fb66c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.170+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00ca10 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.171+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c00cb70 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.171+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c013470 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.171+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674009390 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.171+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840aaac0 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.172+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840ab280 con 0x7fb684155a20 2024-08-17T02:30:59.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.172+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb66c013820 con 0x7fb684155a20 2024-08-17T02:30:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.174+0000 7fb67b400640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 0x7fb660067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.174+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb66c082470 con 0x7fb684155a20 2024-08-17T02:30:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.174+0000 7fb683e00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 0x7fb660067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.175+0000 7fb683e00640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 0x7fb660067630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb674036000 tx=0x7fb674037000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.178+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb66c0507e0 con 0x7fb684155a20 2024-08-17T02:30:59.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.433+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fb684064db0 con 0x7fb684155a20 2024-08-17T02:30:59.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.607+0000 7fb67b400640 1 -- 172.21.15.46:0/1178622199 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v155) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb66c053e00 con 0x7fb684155a20 2024-08-17T02:30:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 msgr2=0x7fb660067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 0x7fb660067630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb674036000 tx=0x7fb674037000 comp rx=0 tx=0).stop 2024-08-17T02:30:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 msgr2=0x7fb68415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00ea70 tx=0x7fb66c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 shutdown_connections 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb660065180 0x7fb660067630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb684155df0 0x7fb68415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb684155a20 0x7fb68415a260 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 --2- 172.21.15.46:0/1178622199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb68406d7f0 0x7fb684142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 >> 172.21.15.46:0/1178622199 conn(0x7fb6840cb9b0 msgr2=0x7fb684157660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 shutdown_connections 2024-08-17T02:30:59.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:30:59.609+0000 7fb68b200640 1 -- 172.21.15.46:0/1178622199 wait complete. 2024-08-17T02:30:59.629 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:30:59.629 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:59.629 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:59.629 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:59.629 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:59.630 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000237964 --yes-i-really-mean-it' 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:59.631 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.340s 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:30:59.632 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000237964 --yes-i-really-mean-it' 2024-08-17T02:30:59.633 INFO:tasks.cephfs_test_runner: 2024-08-17T02:30:59.634 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:59.852 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5a4b371ffb274b5782327341207f5f8a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:30:59.854 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:30:59.862 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:30:59.909 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:30:59.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:59.909 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:30:59.949 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:30:59.949 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:30:59.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:59.949 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:31:00.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:31:00.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-08-17T02:31:00.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.587 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-08-17T02:31:00.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-08-17T02:31:00.725 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-08-17T02:31:00.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:00.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.728 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:31:00.769 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:31:00.769 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:31:00.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.769 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:31:00.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:00.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:31:01.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:01.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-17T02:31:01.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:01.416 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-08-17T02:31:01.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:01.451 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-08-17T02:31:01.551 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-08-17T02:31:01.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:01.554 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:31:01.563 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:31:01.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.727+0000 7f6458a00640 1 Processor -- start 2024-08-17T02:31:01.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.727+0000 7f6458a00640 1 -- start start 2024-08-17T02:31:01.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f645406da20 0x7f645406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64540aa7d0 0x7f6454158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6454158dd0 0x7f64540ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540ac400 con 0x7f645406da20 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540a9a10 con 0x7f64540aa7d0 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6458a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540a9cf0 con 0x7f6454158dd0 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.728+0000 7f6451e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f645406da20 0x7f645406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f645406da20 0x7f645406ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51600/0 (socket says 172.21.15.46:51600) 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 -- 172.21.15.46:0/2407076965 learned_addr learned my addr 172.21.15.46:0/2407076965 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6452800640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6454158dd0 0x7f64540ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451400640 1 --2- 172.21.15.46:0/2407076965 >> v2:172.21.15.162:3300/0 conn(0x7f64540aa7d0 0x7f6454158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 -- 172.21.15.46:0/2407076965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6454158dd0 msgr2=0x7f64540ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6454158dd0 0x7f64540ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 -- 172.21.15.46:0/2407076965 >> v2:172.21.15.162:3300/0 conn(0x7f64540aa7d0 msgr2=0x7f6454158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 --2- 172.21.15.46:0/2407076965 >> v2:172.21.15.162:3300/0 conn(0x7f64540aa7d0 0x7f6454158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.729+0000 7f6451e00640 1 -- 172.21.15.46:0/2407076965 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540a9fd0 con 0x7f645406da20 2024-08-17T02:31:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.730+0000 7f6451e00640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f645406da20 0x7f645406ddf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64540ccaa0 tx=0x7f64440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54a7422e122d0b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.730+0000 7f6450a00640 1 -- 172.21.15.46:0/2407076965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644402ad40 con 0x7f645406da20 2024-08-17T02:31:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.730+0000 7f6450a00640 1 -- 172.21.15.46:0/2407076965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6444032440 con 0x7f645406da20 2024-08-17T02:31:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.730+0000 7f6450a00640 1 -- 172.21.15.46:0/2407076965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644402aea0 con 0x7f645406da20 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 -- 172.21.15.46:0/2407076965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f645406da20 msgr2=0x7f645406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f645406da20 0x7f645406ddf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f64540ccaa0 tx=0x7f64440091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 -- 172.21.15.46:0/2407076965 shutdown_connections 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6454158dd0 0x7f64540ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 --2- 172.21.15.46:0/2407076965 >> v2:172.21.15.162:3300/0 conn(0x7f64540aa7d0 0x7f6454158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 --2- 172.21.15.46:0/2407076965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f645406da20 0x7f645406ddf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 -- 172.21.15.46:0/2407076965 >> 172.21.15.46:0/2407076965 conn(0x7f64540cb9b0 msgr2=0x7f64540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 -- 172.21.15.46:0/2407076965 shutdown_connections 2024-08-17T02:31:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.731+0000 7f6458a00640 1 -- 172.21.15.46:0/2407076965 wait complete. 2024-08-17T02:31:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.732+0000 7f6458a00640 1 Processor -- start 2024-08-17T02:31:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.732+0000 7f6458a00640 1 -- start start 2024-08-17T02:31:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645406da20 0x7f6454153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6454158dd0 0x7f6454169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540c9860 con 0x7f64540aa7d0 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540c9b40 con 0x7f6454158dd0 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.733+0000 7f6458a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540c9e20 con 0x7f645406da20 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51608/0 (socket says 172.21.15.46:51608) 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 -- 172.21.15.46:0/806185065 learned_addr learned my addr 172.21.15.46:0/806185065 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:01.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451e00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645406da20 0x7f6454153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6452800640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6454158dd0 0x7f6454169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 -- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645406da20 msgr2=0x7f6454153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645406da20 0x7f6454153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 -- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6454158dd0 msgr2=0x7f6454169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6454158dd0 0x7f6454169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 -- 172.21.15.46:0/806185065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009450 con 0x7f64540aa7d0 2024-08-17T02:31:01.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.734+0000 7f6451400640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f644000ea20 tx=0x7f64400090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.735+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000ca10 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.735+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000cb70 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.735+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440013470 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.735+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64540ca100 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.735+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540ca900 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.736+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64540ca580 con 0x7f64540aa7d0 2024-08-17T02:31:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.737+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6440013860 con 0x7f64540aa7d0 2024-08-17T02:31:01.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.737+0000 7f6449600640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 0x7f6434067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.738+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6440082490 con 0x7f64540aa7d0 2024-08-17T02:31:01.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.738+0000 7f6451e00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 0x7f6434067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.739+0000 7f6451e00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 0x7f6434067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6444034000 tx=0x7f6444032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.741+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6440050800 con 0x7f64540aa7d0 2024-08-17T02:31:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.923+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64540cab80 con 0x7f64540aa7d0 2024-08-17T02:31:01.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.924+0000 7f6449600640 1 -- 172.21.15.46:0/806185065 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12393 (secure 0 0 0) 0x7f6440053e20 con 0x7f64540aa7d0 2024-08-17T02:31:01.925 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:01.925 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:30:58.598125+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6832/2986162154":"2024-08-18T02:30:55.419516+0000","172.21.15.46:6833/2986162154":"2024-08-18T02:30:55.419516+0000","172.21.15.46:6835/1370984622":"2024-08-18T02:30:48.559373+0000","172.21.15.46:6834/1370984622":"2024-08-18T02:30:48.559373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:01.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 msgr2=0x7f6434067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 0x7f6434067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6444034000 tx=0x7f6444032000 comp rx=0 tx=0).stop 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 msgr2=0x7f64541541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f644000ea20 tx=0x7f64400090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 shutdown_connections 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6454158dd0 0x7f6454169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f64540aa7d0 0x7f64541541a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f6434065150 0x7f6434067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 --2- 172.21.15.46:0/806185065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f645406da20 0x7f6454153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 >> 172.21.15.46:0/806185065 conn(0x7f64540cb9b0 msgr2=0x7f64540ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 shutdown_connections 2024-08-17T02:31:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:01.926+0000 7f6458a00640 1 -- 172.21.15.46:0/806185065 wait complete. 2024-08-17T02:31:01.942 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:31:01.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.093+0000 7f02e2600640 1 Processor -- start 2024-08-17T02:31:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.093+0000 7f02e2600640 1 -- start start 2024-08-17T02:31:02.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.094+0000 7f02e2600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02dc06df00 0x7f02dc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.094+0000 7f02e2600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155df0 0x7f02dc0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.094+0000 7f02e2600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc156670 con 0x7f02dc155a20 2024-08-17T02:31:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.094+0000 7f02e2600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0b0350 con 0x7f02dc06df00 2024-08-17T02:31:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.094+0000 7f02e2600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc06e5e0 con 0x7f02dc155df0 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02dc06df00 0x7f02dc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155df0 0x7f02dc0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02dc06df00 0x7f02dc0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:51260/0 (socket says 172.21.15.46:51260) 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 -- 172.21.15.46:0/1993945262 learned_addr learned my addr 172.21.15.46:0/1993945262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02db400640 1 --1- 172.21.15.46:0/1993945262 >> v1:172.21.15.162:6789/0 conn(0x7f02dc155a20 0x7f02dc06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:32862/0 (socket says 172.21.15.46:32862) 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 -- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155df0 msgr2=0x7f02dc0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 --2- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155df0 0x7f02dc0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 -- 172.21.15.46:0/1993945262 >> v1:172.21.15.162:6789/0 conn(0x7f02dc155a20 legacy=0x7f02dc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.095+0000 7f02daa00640 1 -- 172.21.15.46:0/1993945262 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc06e8c0 con 0x7f02dc06df00 2024-08-17T02:31:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.096+0000 7f02daa00640 1 --2- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc06df00 0x7f02dc0adf10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009910 tx=0x7f02c80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebdf649f7f266c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.096+0000 7f02da000640 1 -- 172.21.15.46:0/1993945262 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c802ae40 con 0x7f02dc06df00 2024-08-17T02:31:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.096+0000 7f02da000640 1 -- 172.21.15.46:0/1993945262 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8032440 con 0x7f02dc06df00 2024-08-17T02:31:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.096+0000 7f02da000640 1 -- 172.21.15.46:0/1993945262 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8032820 con 0x7f02dc06df00 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 -- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc06df00 msgr2=0x7f02dc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 --2- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc06df00 0x7f02dc0adf10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009910 tx=0x7f02c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 -- 172.21.15.46:0/1993945262 shutdown_connections 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 --2- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155df0 0x7f02dc0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 --2- 172.21.15.46:0/1993945262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc06df00 0x7f02dc0adf10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 -- 172.21.15.46:0/1993945262 >> 172.21.15.46:0/1993945262 conn(0x7f02dc0cb9b0 msgr2=0x7f02dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 -- 172.21.15.46:0/1993945262 shutdown_connections 2024-08-17T02:31:02.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.097+0000 7f02e2600640 1 -- 172.21.15.46:0/1993945262 wait complete. 2024-08-17T02:31:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.098+0000 7f02e2600640 1 Processor -- start 2024-08-17T02:31:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.098+0000 7f02e2600640 1 -- start start 2024-08-17T02:31:02.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155a20 0x7f02dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc155df0 0x7f02dc0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc068cf0 con 0x7f02dc06df00 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc143fc0 con 0x7f02dc155df0 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.099+0000 7f02e2600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc068f00 con 0x7f02dc155a20 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51620/0 (socket says 172.21.15.46:51620) 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 -- 172.21.15.46:0/1859622019 learned_addr learned my addr 172.21.15.46:0/1859622019 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02dbe00640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc155df0 0x7f02dc0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02daa00640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155a20 0x7f02dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 -- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155a20 msgr2=0x7f02dc0687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155a20 0x7f02dc0687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 -- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc155df0 msgr2=0x7f02dc0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc155df0 0x7f02dc0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 -- 172.21.15.46:0/1859622019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8009450 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.100+0000 7f02db400640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c590 tx=0x7f02cc007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.101+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc007300 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.101+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc0074a0 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.101+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0047a0 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.101+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0691e0 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.101+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0697a0 con 0x7f02dc06df00 2024-08-17T02:31:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.102+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02dc064db0 con 0x7f02dc06df00 2024-08-17T02:31:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.103+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f02cc004bd0 con 0x7f02dc06df00 2024-08-17T02:31:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.103+0000 7f02d2a00640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.103+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f02cc081190 con 0x7f02dc06df00 2024-08-17T02:31:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.104+0000 7f02daa00640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.105+0000 7f02daa00640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 0x7f02bc067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02c8034000 tx=0x7f02c8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.107+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f02cc04be40 con 0x7f02dc06df00 2024-08-17T02:31:02.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.285+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02dc1536e0 con 0x7f02bc065150 2024-08-17T02:31:02.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.289+0000 7f02d2a00640 1 -- 172.21.15.46:0/1859622019 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50513 (secure 0 0 0) 0x7f02dc1536e0 con 0x7f02bc065150 2024-08-17T02:31:02.289 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:02.290 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:31:02.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 msgr2=0x7f02bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 0x7f02bc067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02c8034000 tx=0x7f02c8032000 comp rx=0 tx=0).stop 2024-08-17T02:31:02.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 msgr2=0x7f02dc1698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c590 tx=0x7f02cc007ee0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 shutdown_connections 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02dc155df0 0x7f02dc0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f02bc065150 0x7f02bc067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02dc155a20 0x7f02dc0687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 --2- 172.21.15.46:0/1859622019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02dc06df00 0x7f02dc1698c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 >> 172.21.15.46:0/1859622019 conn(0x7f02dc0cb9b0 msgr2=0x7f02dc154230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 shutdown_connections 2024-08-17T02:31:02.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.290+0000 7f02e2600640 1 -- 172.21.15.46:0/1859622019 wait complete. 2024-08-17T02:31:02.307 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-17T02:31:01.066193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2400360,"kb_used_data":4872,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574360,"statfs":{"total":773094113280,"available":770636144640,"internally_reserved":0,"allocated":4988928,"data_stored":2736636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-17T02:30:51.866594+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:30:51.866594+0000","last_peered":"2024-08-17T02:30:51.866594+0000","last_clean":"2024-08-17T02:30:51.866594+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:30:51.866594+0000","last_undegraded":"2024-08-17T02:30:51.866594+0000","last_fullsized":"2024-08-17T02:30:51.866594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1064960,"data_stored":784361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63500000000000001,"15min":0.59699999999999998},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.65400000000000003},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.60699999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84499999999999997,"5min":1.264,"15min":1.264},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":194563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.52900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71999999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.71,"15min":1.71},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89100000000000001,"5min":1.375,"15min":1.375},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.89200000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84299999999999997,"5min":1.361,"15min":1.361},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1899999999999999,"5min":1.262,"15min":1.262},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.63900000000000001},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.56399999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65700000000000003,"15min":0.61399999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.628},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.65000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.254,"15min":1.254},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.63200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":1.04,"15min":1.04},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1319999999999999,"5min":1.208,"15min":1.208},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.67400000000000004,"5min":0.998,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78200000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":1.27,"15min":1.27},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73999999999999999,"15min":0.76500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.468,"15min":1.468},"last":0.64600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":195455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89100000000000001,"5min":1.194,"15min":1.194},"last":0.63}]},{"osd":1,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.746,"15min":0.72199999999999998},"min":{"1min":0.71199999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.94499999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.68300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.137,"15min":1.137},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.59899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91600000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98199999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.052,"15min":1.052},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.748,"5min":1.161,"15min":1.161},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.016,"15min":1.016},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89800000000000002,"5min":1.264,"15min":1.264},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301984,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069856,"statfs":{"total":96636764160,"available":96327532544,"internally_reserved":0,"allocated":479232,"data_stored":194529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67500000000000004,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.321,"15min":1.321},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":1.742,"15min":1.742},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.754},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.248,"15min":1.248},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.78300000000000003},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0229999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80600000000000005,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":2.327,"15min":2.327},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.036,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.99199999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.873},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.81899999999999995},"min":{"1min":0.65700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.03,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.0780000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.747},{"interface":"front","average":{"1min":0.874,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.321,"15min":1.321},"last":1}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":195477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74299999999999999,"5min":1.109,"15min":1.109},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.45100000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51700000000000002,"15min":0.48699999999999999},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76700000000000002,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98599999999999999,"5min":1.165,"15min":1.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.069,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.64600000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0569999999999999,"5min":1.343,"15min":1.343},"last":1.095}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.66300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0940000000000001,"5min":1.246,"15min":1.246},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.78900000000000003},"min":{"1min":0.627,"5min":0.504,"15min":0.504},"max":{"1min":1.0049999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.877},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.23,"15min":1.23},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":1.079,"15min":1.079},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61199999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.749,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.66900000000000004},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.745}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.66100000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77700000000000002,"15min":0.755},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0109999999999999,"5min":1.103,"15min":1.103},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0029999999999999,"5min":1.149,"15min":1.149},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1064960,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84999999999999998,"5min":1.992,"15min":1.992},"last":0.436},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64100000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58699999999999997,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66900000000000004,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90400000000000003,"5min":1.843,"15min":1.843},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":1.962,"15min":1.962},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0960000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0589999999999999,"5min":2.056,"15min":2.056},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.84499999999999997},"min":{"1min":0.64300000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.911,"15min":1.911},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.879},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92000000000000004,"5min":1.587,"15min":1.587},"last":0.76600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85699999999999998,"15min":0.89000000000000001},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97799999999999998,"5min":1.72,"15min":1.72},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.873,"15min":0.90800000000000003},"min":{"1min":0.621,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:02.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.460+0000 7f711f200640 1 Processor -- start 2024-08-17T02:31:02.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.461+0000 7f711f200640 1 -- start start 2024-08-17T02:31:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7120155900 0x7f7120155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71200b0270 0x7f7120156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7120157b20 0x7f7120157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7120157690 con 0x7f7120157b20 2024-08-17T02:31:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7120156a80 con 0x7f7120155900 2024-08-17T02:31:02.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7120156d60 con 0x7f71200b0270 2024-08-17T02:31:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7120157b20 0x7f7120157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711e800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7120157b20 0x7f7120157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51628/0 (socket says 172.21.15.46:51628) 2024-08-17T02:31:02.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711e800640 1 -- 172.21.15.46:0/3349611432 learned_addr learned my addr 172.21.15.46:0/3349611432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f7117e00640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71200b0270 0x7f7120156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.462+0000 7f711de00640 1 --2- 172.21.15.46:0/3349611432 >> v2:172.21.15.162:3300/0 conn(0x7f7120155900 0x7f7120155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.463+0000 7f711e800640 1 -- 172.21.15.46:0/3349611432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71200b0270 msgr2=0x7f7120156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.463+0000 7f711e800640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71200b0270 0x7f7120156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.463+0000 7f711e800640 1 -- 172.21.15.46:0/3349611432 >> v2:172.21.15.162:3300/0 conn(0x7f7120155900 msgr2=0x7f7120155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.463+0000 7f711e800640 1 --2- 172.21.15.46:0/3349611432 >> v2:172.21.15.162:3300/0 conn(0x7f7120155900 0x7f7120155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.463+0000 7f711e800640 1 -- 172.21.15.46:0/3349611432 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120157040 con 0x7f7120157b20 2024-08-17T02:31:02.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711e800640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120157b20 0x7f7120157fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7120065fd0 tx=0x7f711800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9ed0a62ab0003d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711d400640 1 -- 172.21.15.46:0/3349611432 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800b2e0 con 0x7f7120157b20 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711d400640 1 -- 172.21.15.46:0/3349611432 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800b440 con 0x7f7120157b20 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711d400640 1 -- 172.21.15.46:0/3349611432 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118009840 con 0x7f7120157b20 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711f200640 1 -- 172.21.15.46:0/3349611432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120157b20 msgr2=0x7f7120157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.464+0000 7f711f200640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120157b20 0x7f7120157fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7120065fd0 tx=0x7f711800ba50 comp rx=0 tx=0).stop 2024-08-17T02:31:02.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 -- 172.21.15.46:0/3349611432 shutdown_connections 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120157b20 0x7f7120157fa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 --2- 172.21.15.46:0/3349611432 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71200b0270 0x7f7120156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 --2- 172.21.15.46:0/3349611432 >> v2:172.21.15.162:3300/0 conn(0x7f7120155900 0x7f7120155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 -- 172.21.15.46:0/3349611432 >> 172.21.15.46:0/3349611432 conn(0x7f7120067750 msgr2=0x7f71200cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 -- 172.21.15.46:0/3349611432 shutdown_connections 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.465+0000 7f711f200640 1 -- 172.21.15.46:0/3349611432 wait complete. 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.466+0000 7f711f200640 1 Processor -- start 2024-08-17T02:31:02.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.466+0000 7f711f200640 1 -- start start 2024-08-17T02:31:02.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71200b0270 0x7f712016cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 0x7f7120168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712015b2d0 con 0x7f7120155900 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712015c130 con 0x7f71200b0270 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f711f200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712016d460 con 0x7f7120157b20 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.467+0000 7f7117e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f7117e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51642/0 (socket says 172.21.15.46:51642) 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f7117e00640 1 -- 172.21.15.46:0/32833686 learned_addr learned my addr 172.21.15.46:0/32833686 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 0x7f7120168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711de00640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71200b0270 0x7f712016cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 -- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71200b0270 msgr2=0x7f712016cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71200b0270 0x7f712016cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 -- 172.21.15.46:0/32833686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 msgr2=0x7f7120152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 -- 172.21.15.46:0/32833686 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711800bcf0 con 0x7f7120157b20 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f7117e00640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:02.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.468+0000 7f711e800640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 0x7f7120168ee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7118033000 tx=0x7f7118039000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.469+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800b2e0 con 0x7f7120157b20 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.469+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118033e60 con 0x7f7120157b20 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.469+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7120152f90 con 0x7f7120157b20 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.469+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711803c660 con 0x7f7120157b20 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.469+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712015b800 con 0x7f7120157b20 2024-08-17T02:31:02.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.470+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712015c2c0 con 0x7f7120157b20 2024-08-17T02:31:02.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.471+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7118031070 con 0x7f7120157b20 2024-08-17T02:31:02.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.471+0000 7f7115600640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 0x7f70fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.472+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f71180a3800 con 0x7f7120157b20 2024-08-17T02:31:02.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.472+0000 7f711de00640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 0x7f70fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.472+0000 7f711de00640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 0x7f70fc067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d20 tx=0x7f71100090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.477+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7118071b70 con 0x7f7120157b20 2024-08-17T02:31:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.655+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7120071050 con 0x7f70fc065150 2024-08-17T02:31:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.659+0000 7f7115600640 1 -- 172.21.15.46:0/32833686 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50513 (secure 0 0 0) 0x7f7120071050 con 0x7f70fc065150 2024-08-17T02:31:02.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:31:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 msgr2=0x7f70fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 0x7f70fc067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7110009d20 tx=0x7f71100090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 msgr2=0x7f7120168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 0x7f7120168ee0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7118033000 tx=0x7f7118039000 comp rx=0 tx=0).stop 2024-08-17T02:31:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 shutdown_connections 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f70fc065150 0x7f70fc067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7120157b20 0x7f7120168ee0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7120155900 0x7f7120152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 --2- 172.21.15.46:0/32833686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71200b0270 0x7f712016cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 >> 172.21.15.46:0/32833686 conn(0x7f7120067750 msgr2=0x7f7120154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 shutdown_connections 2024-08-17T02:31:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.660+0000 7f711f200640 1 -- 172.21.15.46:0/32833686 wait complete. 2024-08-17T02:31:02.675 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-17T02:31:01.066193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2400360,"kb_used_data":4872,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574360,"statfs":{"total":773094113280,"available":770636144640,"internally_reserved":0,"allocated":4988928,"data_stored":2736636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-17T02:30:51.866594+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:30:51.866594+0000","last_peered":"2024-08-17T02:30:51.866594+0000","last_clean":"2024-08-17T02:30:51.866594+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:30:51.866594+0000","last_undegraded":"2024-08-17T02:30:51.866594+0000","last_fullsized":"2024-08-17T02:30:51.866594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1064960,"data_stored":784361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63500000000000001,"15min":0.59699999999999998},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.65400000000000003},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.60699999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84499999999999997,"5min":1.264,"15min":1.264},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":194563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.52900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71999999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.71,"15min":1.71},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89100000000000001,"5min":1.375,"15min":1.375},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.89200000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84299999999999997,"5min":1.361,"15min":1.361},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1899999999999999,"5min":1.262,"15min":1.262},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.63900000000000001},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.56399999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65700000000000003,"15min":0.61399999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.628},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.65000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.254,"15min":1.254},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.63200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":1.04,"15min":1.04},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1319999999999999,"5min":1.208,"15min":1.208},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.67400000000000004,"5min":0.998,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78200000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":1.27,"15min":1.27},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73999999999999999,"15min":0.76500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.468,"15min":1.468},"last":0.64600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":195455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89100000000000001,"5min":1.194,"15min":1.194},"last":0.63}]},{"osd":1,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.746,"15min":0.72199999999999998},"min":{"1min":0.71199999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.94499999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.68300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.137,"15min":1.137},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.59899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91600000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98199999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.052,"15min":1.052},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.748,"5min":1.161,"15min":1.161},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.016,"15min":1.016},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89800000000000002,"5min":1.264,"15min":1.264},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301984,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069856,"statfs":{"total":96636764160,"available":96327532544,"internally_reserved":0,"allocated":479232,"data_stored":194529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67500000000000004,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.321,"15min":1.321},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":1.742,"15min":1.742},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.754},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.248,"15min":1.248},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.78300000000000003},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0229999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80600000000000005,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":2.327,"15min":2.327},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.036,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.99199999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.873},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.81899999999999995},"min":{"1min":0.65700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.03,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.0780000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.747},{"interface":"front","average":{"1min":0.874,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.321,"15min":1.321},"last":1}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":195477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74299999999999999,"5min":1.109,"15min":1.109},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.45100000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51700000000000002,"15min":0.48699999999999999},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76700000000000002,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98599999999999999,"5min":1.165,"15min":1.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.069,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.64600000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0569999999999999,"5min":1.343,"15min":1.343},"last":1.095}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.66300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0940000000000001,"5min":1.246,"15min":1.246},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.78900000000000003},"min":{"1min":0.627,"5min":0.504,"15min":0.504},"max":{"1min":1.0049999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.877},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.23,"15min":1.23},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":1.079,"15min":1.079},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61199999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.749,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.66900000000000004},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.745}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.66100000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77700000000000002,"15min":0.755},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0109999999999999,"5min":1.103,"15min":1.103},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0029999999999999,"5min":1.149,"15min":1.149},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1064960,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84999999999999998,"5min":1.992,"15min":1.992},"last":0.436},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64100000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58699999999999997,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66900000000000004,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90400000000000003,"5min":1.843,"15min":1.843},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":1.962,"15min":1.962},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0960000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0589999999999999,"5min":2.056,"15min":2.056},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.84499999999999997},"min":{"1min":0.64300000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.911,"15min":1.911},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.879},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92000000000000004,"5min":1.587,"15min":1.587},"last":0.76600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85699999999999998,"15min":0.89000000000000001},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97799999999999998,"5min":1.72,"15min":1.72},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.873,"15min":0.90800000000000003},"min":{"1min":0.621,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:02.677 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:31:02.677 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:02.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 Processor -- start 2024-08-17T02:31:02.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 -- start start 2024-08-17T02:31:02.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc900cc010 0x7efc900ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc900ab950 con 0x7efc900a98e0 2024-08-17T02:31:02.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc900abc30 con 0x7efc9015c7c0 2024-08-17T02:31:02.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc96200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc900abf10 con 0x7efc900cc010 2024-08-17T02:31:02.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc94e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc900cc010 0x7efc900ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc94e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc900cc010 0x7efc900ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51654/0 (socket says 172.21.15.46:51654) 2024-08-17T02:31:02.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc94e00640 1 -- 172.21.15.46:0/2478039494 learned_addr learned my addr 172.21.15.46:0/2478039494 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.829+0000 7efc87e00640 1 --1- 172.21.15.46:0/2478039494 >> v1:172.21.15.46:6789/0 conn(0x7efc900a98e0 0x7efc900afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40698/0 (socket says 172.21.15.46:40698) 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.830+0000 7efc94e00640 1 -- 172.21.15.46:0/2478039494 >> v1:172.21.15.162:6789/0 conn(0x7efc9015c7c0 legacy=0x7efc90066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.830+0000 7efc94e00640 1 -- 172.21.15.46:0/2478039494 >> v1:172.21.15.46:6789/0 conn(0x7efc900a98e0 legacy=0x7efc900afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.830+0000 7efc94e00640 1 -- 172.21.15.46:0/2478039494 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc900af970 con 0x7efc900cc010 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.831+0000 7efc94e00640 1 --2- 172.21.15.46:0/2478039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc900ab2b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efc80009910 tx=0x7efc800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eb2e3c18a4bc90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.831+0000 7efc8fe00640 1 -- 172.21.15.46:0/2478039494 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8002aca0 con 0x7efc900cc010 2024-08-17T02:31:02.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.831+0000 7efc8fe00640 1 -- 172.21.15.46:0/2478039494 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8002ae00 con 0x7efc900cc010 2024-08-17T02:31:02.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.831+0000 7efc8fe00640 1 -- 172.21.15.46:0/2478039494 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80032670 con 0x7efc900cc010 2024-08-17T02:31:02.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 -- 172.21.15.46:0/2478039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 msgr2=0x7efc900ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 --2- 172.21.15.46:0/2478039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc900ab2b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efc80009910 tx=0x7efc800091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 -- 172.21.15.46:0/2478039494 shutdown_connections 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 --2- 172.21.15.46:0/2478039494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc900ab2b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 -- 172.21.15.46:0/2478039494 >> 172.21.15.46:0/2478039494 conn(0x7efc90067de0 msgr2=0x7efc900681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 -- 172.21.15.46:0/2478039494 shutdown_connections 2024-08-17T02:31:02.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.832+0000 7efc96200640 1 -- 172.21.15.46:0/2478039494 wait complete. 2024-08-17T02:31:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.833+0000 7efc96200640 1 Processor -- start 2024-08-17T02:31:02.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.833+0000 7efc96200640 1 -- start start 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 0x7efc9013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc9015c7c0 0x7efc90151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc900acba0 con 0x7efc900cc010 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc90154840 con 0x7efc900a98e0 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc96200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc90154b20 con 0x7efc9015c7c0 2024-08-17T02:31:02.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc87e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51660/0 (socket says 172.21.15.46:51660) 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.834+0000 7efc87e00640 1 -- 172.21.15.46:0/3197867798 learned_addr learned my addr 172.21.15.46:0/3197867798 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc94e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 0x7efc9013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc95800640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc9015c7c0 0x7efc90151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 -- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc9015c7c0 msgr2=0x7efc90151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc9015c7c0 0x7efc90151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 -- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 msgr2=0x7efc9013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 0x7efc9013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 -- 172.21.15.46:0/3197867798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80009450 con 0x7efc900cc010 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc94e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 0x7efc9013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc87e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc7800c810 tx=0x7efc78007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc780070f0 con 0x7efc900cc010 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78007270 con 0x7efc900cc010 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78007670 con 0x7efc900cc010 2024-08-17T02:31:02.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90154e00 con 0x7efc900cc010 2024-08-17T02:31:02.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.835+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9013ef60 con 0x7efc900cc010 2024-08-17T02:31:02.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.836+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc900acd50 con 0x7efc900cc010 2024-08-17T02:31:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.837+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc780049b0 con 0x7efc900cc010 2024-08-17T02:31:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.838+0000 7efc8cc00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 0x7efc6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.838+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7efc780817e0 con 0x7efc900cc010 2024-08-17T02:31:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.839+0000 7efc94e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 0x7efc6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.840+0000 7efc94e00640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 0x7efc6c067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc80034000 tx=0x7efc80032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:02.842+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc900acd50 con 0x7efc900cc010 2024-08-17T02:31:03.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.021+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc90071050 con 0x7efc6c065150 2024-08-17T02:31:03.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.024+0000 7efc8cc00640 1 -- 172.21.15.46:0/3197867798 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50513 (secure 0 0 0) 0x7efc90071050 con 0x7efc6c065150 2024-08-17T02:31:03.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:03.025 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:31:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 msgr2=0x7efc6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 0x7efc6c067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efc80034000 tx=0x7efc80032000 comp rx=0 tx=0).stop 2024-08-17T02:31:03.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 msgr2=0x7efc90153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc7800c810 tx=0x7efc78007ec0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 shutdown_connections 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7efc6c065150 0x7efc6c067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc9015c7c0 0x7efc90151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc900cc010 0x7efc90153e10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 --2- 172.21.15.46:0/3197867798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc900a98e0 0x7efc9013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 >> 172.21.15.46:0/3197867798 conn(0x7efc90067de0 msgr2=0x7efc901582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 shutdown_connections 2024-08-17T02:31:03.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.026+0000 7efc96200640 1 -- 172.21.15.46:0/3197867798 wait complete. 2024-08-17T02:31:03.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-08-17T02:31:01.066193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2400360,"kb_used_data":4872,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574360,"statfs":{"total":773094113280,"available":770636144640,"internally_reserved":0,"allocated":4988928,"data_stored":2736636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001315"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":179,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-17T02:30:51.866594+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:30:51.866594+0000","last_peered":"2024-08-17T02:30:51.866594+0000","last_clean":"2024-08-17T02:30:51.866594+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:30:51.866594+0000","last_undegraded":"2024-08-17T02:30:51.866594+0000","last_fullsized":"2024-08-17T02:30:51.866594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1064960,"data_stored":784361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63500000000000001,"15min":0.59699999999999998},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.65400000000000003},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.60699999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.68799999999999994}]},{"osd":2,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84499999999999997,"5min":1.264,"15min":1.264},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.628}]},{"osd":4,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.745}]},{"osd":6,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":475136,"data_stored":194563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.52900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71999999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.71,"15min":1.71},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.91100000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89100000000000001,"5min":1.375,"15min":1.375},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.89200000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84299999999999997,"5min":1.361,"15min":1.361},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1899999999999999,"5min":1.262,"15min":1.262},"last":0.93100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297816,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074024,"statfs":{"total":96636764160,"available":96331800576,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.63900000000000001},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.56399999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65700000000000003,"15min":0.61399999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.628},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.65000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.57499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.254,"15min":1.254},"last":0.505},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.63200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":1.04,"15min":1.04},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1319999999999999,"5min":1.208,"15min":1.208},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.67400000000000004,"5min":0.998,"15min":0.998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78200000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":1.27,"15min":1.27},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73999999999999999,"15min":0.76500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.468,"15min":1.468},"last":0.64600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":479232,"data_stored":195455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89100000000000001,"5min":1.194,"15min":1.194},"last":0.63}]},{"osd":1,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.746,"15min":0.72199999999999998},"min":{"1min":0.71199999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.94499999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.68300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.137,"15min":1.137},"last":0.79000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.59899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91600000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98199999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.052,"15min":1.052},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.748,"5min":1.161,"15min":1.161},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.016,"15min":1.016},"last":0.82599999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89800000000000002,"5min":1.264,"15min":1.264},"last":0.74299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301984,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069856,"statfs":{"total":96636764160,"available":96327532544,"internally_reserved":0,"allocated":479232,"data_stored":194529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39900000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67500000000000004,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.321,"15min":1.321},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":1.742,"15min":1.742},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.754},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.248,"15min":1.248},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.78300000000000003},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0229999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80600000000000005,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":2.327,"15min":2.327},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.036,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.85899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.99199999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.873},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.81899999999999995},"min":{"1min":0.65700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.03,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.94399999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.0780000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.747},{"interface":"front","average":{"1min":0.874,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.321,"15min":1.321},"last":1}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301988,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069852,"statfs":{"total":96636764160,"available":96327528448,"internally_reserved":0,"allocated":483328,"data_stored":195477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74299999999999999,"5min":1.109,"15min":1.109},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.45100000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51700000000000002,"15min":0.48699999999999999},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76700000000000002,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98599999999999999,"5min":1.165,"15min":1.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.069,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.64600000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0569999999999999,"5min":1.343,"15min":1.343},"last":1.095}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.66300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0940000000000001,"5min":1.246,"15min":1.246},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.78900000000000003},"min":{"1min":0.627,"5min":0.504,"15min":0.504},"max":{"1min":1.0049999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.877},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.23,"15min":1.23},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301976,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069864,"statfs":{"total":96636764160,"available":96327540736,"internally_reserved":0,"allocated":471040,"data_stored":193973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":1.079,"15min":1.079},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61199999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.749,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.66900000000000004},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.745}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.66100000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77700000000000002,"15min":0.755},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.72999999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0109999999999999,"5min":1.103,"15min":1.103},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0029999999999999,"5min":1.149,"15min":1.149},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302556,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069284,"statfs":{"total":96636764160,"available":96326946816,"internally_reserved":0,"allocated":1064960,"data_stored":784305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84999999999999998,"5min":1.992,"15min":1.992},"last":0.436},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64100000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58699999999999997,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66900000000000004,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90400000000000003,"5min":1.843,"15min":1.843},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":1.962,"15min":1.962},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0960000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0589999999999999,"5min":2.056,"15min":2.056},"last":0.84399999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.84499999999999997},"min":{"1min":0.64300000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.911,"15min":1.911},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.879},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92000000000000004,"5min":1.587,"15min":1.587},"last":0.76600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85699999999999998,"15min":0.89000000000000001},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97799999999999998,"5min":1.72,"15min":1.72},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.873,"15min":0.90800000000000003},"min":{"1min":0.621,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:03.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.195+0000 7fef11600640 1 Processor -- start 2024-08-17T02:31:03.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.195+0000 7fef11600640 1 -- start start 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef11600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0b1440 0x7fef0c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef11600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef0c140580 0x7fef0c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef11600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c0caa80 con 0x7fef0c1401b0 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef11600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c0cb450 con 0x7fef0c140580 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef11600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c9e70 con 0x7fef0c0b1440 2024-08-17T02:31:03.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0aa00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fef0c1401b0 0x7fef0c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40700/0 (socket says 172.21.15.46:40700) 2024-08-17T02:31:03.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0aa00640 1 -- 172.21.15.46:0/3349597827 learned_addr learned my addr 172.21.15.46:0/3349597827 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0b1440 0x7fef0c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0b400640 1 --2- 172.21.15.46:0/3349597827 >> v2:172.21.15.162:3300/0 conn(0x7fef0c140580 0x7fef0c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716837198 0 0) 0x7fef0c0caa80 con 0x7fef0c1401b0 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feef00034e0 con 0x7fef0c1401b0 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810528519 0 0) 0x7feef00034e0 con 0x7fef0c1401b0 2024-08-17T02:31:03.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0b1440 msgr2=0x7fef0c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0b1440 0x7fef0c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 >> v2:172.21.15.162:3300/0 conn(0x7fef0c140580 msgr2=0x7fef0c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 --2- 172.21.15.46:0/3349597827 >> v2:172.21.15.162:3300/0 conn(0x7fef0c140580 0x7fef0c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0ca150 con 0x7fef0c1401b0 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321339021 0 0) 0x7feefc0017f0 con 0x7fef0c1401b0 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 >> v1:172.21.15.46:6789/0 conn(0x7fef0c1401b0 legacy=0x7fef0c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feef0003a50 0x7feef0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7feef0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef0005130 0x7feef000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0cb450 con 0x7feef0004780 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c9e70 con 0x7feef0005130 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef000bf40 con 0x7feef0003a50 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0b1440 0x7fef0c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.196+0000 7fef0b400640 1 --2- 172.21.15.46:0/3349597827 >> v2:172.21.15.162:3300/0 conn(0x7fef0c140580 0x7fef0c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:03.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7feef0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef0aa00640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feef0003a50 0x7feef0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef0b400640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef0005130 0x7feef000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 -- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feef0003a50 msgr2=0x7feef0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feef0003a50 0x7feef0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 -- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef0005130 msgr2=0x7feef000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef0005130 0x7feef000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef02000640 1 -- 172.21.15.46:0/3349597827 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00034e0 con 0x7feef0004780 2024-08-17T02:31:03.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.197+0000 7fef0aa00640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feef0003a50 0x7feef0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.198+0000 7fef02000640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7feef0004bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef0c064560 tx=0x7feef40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230d0a74ce1f4a6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.198+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef402ab20 con 0x7feef0004780 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.198+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef402ac80 con 0x7feef0004780 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.198+0000 7fef0a000640 1 -- 172.21.15.46:0/3349597827 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef40323f0 con 0x7feef0004780 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 -- 172.21.15.46:0/3349597827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 msgr2=0x7feef0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 --2- 172.21.15.46:0/3349597827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7feef0004bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fef0c064560 tx=0x7feef40090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef0b400640 1 -- 172.21.15.46:0/3349597827 reap_dead start 2024-08-17T02:31:03.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 -- 172.21.15.46:0/3349597827 shutdown_connections 2024-08-17T02:31:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 -- 172.21.15.46:0/3349597827 >> 172.21.15.46:0/3349597827 conn(0x7fef0c0cb9b0 msgr2=0x7fef0c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 -- 172.21.15.46:0/3349597827 shutdown_connections 2024-08-17T02:31:03.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.199+0000 7fef11600640 1 -- 172.21.15.46:0/3349597827 wait complete. 2024-08-17T02:31:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.200+0000 7fef11600640 1 Processor -- start 2024-08-17T02:31:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 -- start start 2024-08-17T02:31:03.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0c15e3d0 0x7fef0c15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0c7ce0 0x7fef0c0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c15ed80 con 0x7feef0004780 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c8690 con 0x7fef0c15e3d0 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.201+0000 7fef11600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0c4db0 con 0x7fef0c0c7ce0 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51686/0 (socket says 172.21.15.46:51686) 2024-08-17T02:31:03.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 -- 172.21.15.46:0/4257299631 learned_addr learned my addr 172.21.15.46:0/4257299631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef02000640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0c15e3d0 0x7fef0c15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0b400640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0c7ce0 0x7fef0c0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 -- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0c7ce0 msgr2=0x7fef0c0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0c7ce0 0x7fef0c0c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 -- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0c15e3d0 msgr2=0x7fef0c15e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0c15e3d0 0x7fef0c15e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 -- 172.21.15.46:0/4257299631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c15ef90 con 0x7feef0004780 2024-08-17T02:31:03.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.202+0000 7fef0aa00640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feefc00ada0 tx=0x7feefc002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.203+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc0078c0 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.203+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc007a20 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.203+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc013640 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.203+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0c15f270 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.203+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c0c5000 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.204+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0c5250 con 0x7feef0004780 2024-08-17T02:31:03.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.204+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feefc0139b0 con 0x7feef0004780 2024-08-17T02:31:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.205+0000 7fef02a00640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 0x7feee8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.205+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7feefc082db0 con 0x7feef0004780 2024-08-17T02:31:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.206+0000 7fef02000640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 0x7feee8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.206+0000 7fef02000640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 0x7feee8067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feef4033000 tx=0x7feef4031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.209+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feefc087070 con 0x7feef0004780 2024-08-17T02:31:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.392+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef0c064db0 con 0x7feef0004780 2024-08-17T02:31:03.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.393+0000 7fef02a00640 1 -- 172.21.15.46:0/4257299631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12393 (secure 0 0 0) 0x7feefc054bc0 con 0x7feef0004780 2024-08-17T02:31:03.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:03.394 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":42,"fsid":"cdf034cd-9476-4b1b-a305-19ec575459d2","created":"2024-08-17T02:27:20.480365+0000","modified":"2024-08-17T02:30:58.598125+0000","last_up_change":"2024-08-17T02:27:31.771983+0000","last_in_change":"2024-08-17T02:27:23.353290+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:33.065453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"39f64227-580b-44c5-a165-190472c6b276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6823","nonce":37558},{"type":"v1","addr":"172.21.15.46:6824","nonce":37558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":37558},{"type":"v1","addr":"172.21.15.46:6827","nonce":37558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":37558},{"type":"v1","addr":"172.21.15.46:6831","nonce":37558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":37558},{"type":"v1","addr":"172.21.15.46:6829","nonce":37558}]},"public_addr":"172.21.15.46:6824/37558","cluster_addr":"172.21.15.46:6827/37558","heartbeat_back_addr":"172.21.15.46:6831/37558","heartbeat_front_addr":"172.21.15.46:6829/37558","state":["exists","up"]},{"osd":1,"uuid":"ab5fafbd-63f3-4437-b422-3379704e5d8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":37552},{"type":"v1","addr":"172.21.15.46:6801","nonce":37552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":37552},{"type":"v1","addr":"172.21.15.46:6803","nonce":37552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":37552},{"type":"v1","addr":"172.21.15.46:6807","nonce":37552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":37552},{"type":"v1","addr":"172.21.15.46:6805","nonce":37552}]},"public_addr":"172.21.15.46:6801/37552","cluster_addr":"172.21.15.46:6803/37552","heartbeat_back_addr":"172.21.15.46:6807/37552","heartbeat_front_addr":"172.21.15.46:6805/37552","state":["exists","up"]},{"osd":2,"uuid":"fd0b2639-63af-44a9-ad7f-61b338f6aeee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":37554},{"type":"v1","addr":"172.21.15.46:6811","nonce":37554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6813","nonce":37554},{"type":"v1","addr":"172.21.15.46:6814","nonce":37554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":37554},{"type":"v1","addr":"172.21.15.46:6821","nonce":37554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":37554},{"type":"v1","addr":"172.21.15.46:6818","nonce":37554}]},"public_addr":"172.21.15.46:6811/37554","cluster_addr":"172.21.15.46:6814/37554","heartbeat_back_addr":"172.21.15.46:6821/37554","heartbeat_front_addr":"172.21.15.46:6818/37554","state":["exists","up"]},{"osd":3,"uuid":"d45b8fab-8a00-4831-a8aa-14dcded49d30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":37556},{"type":"v1","addr":"172.21.15.46:6810","nonce":37556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":37556},{"type":"v1","addr":"172.21.15.46:6815","nonce":37556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":37556},{"type":"v1","addr":"172.21.15.46:6825","nonce":37556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6817","nonce":37556},{"type":"v1","addr":"172.21.15.46:6820","nonce":37556}]},"public_addr":"172.21.15.46:6810/37556","cluster_addr":"172.21.15.46:6815/37556","heartbeat_back_addr":"172.21.15.46:6825/37556","heartbeat_front_addr":"172.21.15.46:6820/37556","state":["exists","up"]},{"osd":4,"uuid":"74a43019-e173-4f34-8207-f65ac3f1c6d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":37608},{"type":"v1","addr":"172.21.15.162:6817","nonce":37608}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":37608},{"type":"v1","addr":"172.21.15.162:6819","nonce":37608}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":37608},{"type":"v1","addr":"172.21.15.162:6823","nonce":37608}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":37608},{"type":"v1","addr":"172.21.15.162:6821","nonce":37608}]},"public_addr":"172.21.15.162:6817/37608","cluster_addr":"172.21.15.162:6819/37608","heartbeat_back_addr":"172.21.15.162:6823/37608","heartbeat_front_addr":"172.21.15.162:6821/37608","state":["exists","up"]},{"osd":5,"uuid":"b39293a8-0765-4a1f-a686-ac594d9b771a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":37606},{"type":"v1","addr":"172.21.15.162:6801","nonce":37606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":37606},{"type":"v1","addr":"172.21.15.162:6803","nonce":37606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":37606},{"type":"v1","addr":"172.21.15.162:6807","nonce":37606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":37606},{"type":"v1","addr":"172.21.15.162:6805","nonce":37606}]},"public_addr":"172.21.15.162:6801/37606","cluster_addr":"172.21.15.162:6803/37606","heartbeat_back_addr":"172.21.15.162:6807/37606","heartbeat_front_addr":"172.21.15.162:6805/37606","state":["exists","up"]},{"osd":6,"uuid":"f17cc47e-9c3e-4a3b-a82e-1bf2af42bb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":37607},{"type":"v1","addr":"172.21.15.162:6809","nonce":37607}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":37607},{"type":"v1","addr":"172.21.15.162:6811","nonce":37607}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":37607},{"type":"v1","addr":"172.21.15.162:6815","nonce":37607}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":37607},{"type":"v1","addr":"172.21.15.162:6813","nonce":37607}]},"public_addr":"172.21.15.162:6809/37607","cluster_addr":"172.21.15.162:6811/37607","heartbeat_back_addr":"172.21.15.162:6815/37607","heartbeat_front_addr":"172.21.15.162:6813/37607","state":["exists","up"]},{"osd":7,"uuid":"52c858f0-20c2-49ec-85aa-fc3aac957fcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":37634},{"type":"v1","addr":"172.21.15.162:6825","nonce":37634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":37634},{"type":"v1","addr":"172.21.15.162:6827","nonce":37634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":37634},{"type":"v1","addr":"172.21.15.162:6831","nonce":37634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":37634},{"type":"v1","addr":"172.21.15.162:6829","nonce":37634}]},"public_addr":"172.21.15.162:6825/37634","cluster_addr":"172.21.15.162:6827/37634","heartbeat_back_addr":"172.21.15.162:6831/37634","heartbeat_front_addr":"172.21.15.162:6829/37634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.662715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.877010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774078+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.631575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.774437+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.645852+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.913492+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:28.757157+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:6832/2986162154":"2024-08-18T02:30:55.419516+0000","172.21.15.46:6833/2986162154":"2024-08-18T02:30:55.419516+0000","172.21.15.46:6835/1370984622":"2024-08-18T02:30:48.559373+0000","172.21.15.46:6834/1370984622":"2024-08-18T02:30:48.559373+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 msgr2=0x7feee8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 0x7feee8067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feef4033000 tx=0x7feef4031000 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 msgr2=0x7fef0c15aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feefc00ada0 tx=0x7feefc002140 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 shutdown_connections 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7feee8065150 0x7feee8067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef0c0c7ce0 0x7fef0c0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef0c15e3d0 0x7fef0c15e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 --2- 172.21.15.46:0/4257299631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feef0004780 0x7fef0c15aa20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 >> 172.21.15.46:0/4257299631 conn(0x7fef0c0cb9b0 msgr2=0x7fef0c0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 shutdown_connections 2024-08-17T02:31:03.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:03.395+0000 7fef11600640 1 -- 172.21.15.46:0/4257299631 wait complete. 2024-08-17T02:31:04.412 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:31:04.413 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.576+0000 7f4a24200640 1 Processor -- start 2024-08-17T02:31:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.576+0000 7f4a24200640 1 -- start start 2024-08-17T02:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a1c0b0ad0 0x7f4a1c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b0030 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0aefc0 con 0x7f4a1c0b0ad0 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a24200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0af2a0 con 0x7f4a1c0adc00 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a20e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a20e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51702/0 (socket says 172.21.15.46:51702) 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.577+0000 7f4a20e00640 1 -- 172.21.15.46:0/3035366289 learned_addr learned my addr 172.21.15.46:0/3035366289 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a21800640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a22200640 1 --2- 172.21.15.46:0/3035366289 >> v2:172.21.15.162:3300/0 conn(0x7f4a1c0b0ad0 0x7f4a1c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a20e00640 1 -- 172.21.15.46:0/3035366289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 msgr2=0x7f4a1c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a20e00640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a20e00640 1 -- 172.21.15.46:0/3035366289 >> v2:172.21.15.162:3300/0 conn(0x7f4a1c0b0ad0 msgr2=0x7f4a1c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a20e00640 1 --2- 172.21.15.46:0/3035366289 >> v2:172.21.15.162:3300/0 conn(0x7f4a1c0b0ad0 0x7f4a1c0b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.578+0000 7f4a20e00640 1 -- 172.21.15.46:0/3035366289 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0b02d0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.579+0000 7f4a20e00640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c089000 tx=0x7f4a080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5ef2a887b9197 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.579+0000 7f4a1be00640 1 -- 172.21.15.46:0/3035366289 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0802ad40 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.579+0000 7f4a1be00640 1 -- 172.21.15.46:0/3035366289 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08032440 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.579+0000 7f4a1be00640 1 -- 172.21.15.46:0/3035366289 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0802aea0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 -- 172.21.15.46:0/3035366289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 msgr2=0x7f4a1c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c089000 tx=0x7f4a080091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 -- 172.21.15.46:0/3035366289 shutdown_connections 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 --2- 172.21.15.46:0/3035366289 >> v2:172.21.15.162:3300/0 conn(0x7f4a1c0b0ad0 0x7f4a1c0b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c0b3220 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 --2- 172.21.15.46:0/3035366289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 -- 172.21.15.46:0/3035366289 >> 172.21.15.46:0/3035366289 conn(0x7f4a1c0cfdb0 msgr2=0x7f4a1c0d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 -- 172.21.15.46:0/3035366289 shutdown_connections 2024-08-17T02:31:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.580+0000 7f4a24200640 1 -- 172.21.15.46:0/3035366289 wait complete. 2024-08-17T02:31:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.581+0000 7f4a24200640 1 Processor -- start 2024-08-17T02:31:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.582+0000 7f4a24200640 1 -- start start 2024-08-17T02:31:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.582+0000 7f4a24200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c169560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.582+0000 7f4a24200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c0b0ad0 0x7f4a1c16b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a24200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a24200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c16b3f0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a24200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c16a7e0 con 0x7f4a1c0b0ad0 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a24200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c16aac0 con 0x7f4a1c0adc00 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c169d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51712/0 (socket says 172.21.15.46:51712) 2024-08-17T02:31:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 -- 172.21.15.46:0/1578281864 learned_addr learned my addr 172.21.15.46:0/1578281864 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a20e00640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c0b0ad0 0x7f4a1c16b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a21800640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 -- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 msgr2=0x7f4a1c169560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c169560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 -- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c0b0ad0 msgr2=0x7f4a1c16b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c0b0ad0 0x7f4a1c16b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a22200640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009450 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.583+0000 7f4a21800640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a1c0adc00 0x7f4a1c169560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a22200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c169d40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009e90 tx=0x7f4a1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400ce10 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400f040 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c16ada0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140146d0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.584+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c169aa0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.585+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a1c0710c0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.586+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a14014a80 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a18c00640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f49fc065150 0x7f49fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4a14082d90 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a18c00640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f49fc06b040 0x7f49fc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49fc06db00 con 0x7f49fc06b040 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a140852f0 con 0x7f4a1c0b59f0 2024-08-17T02:31:04.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a21800640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f49fc065150 0x7f49fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.587+0000 7f4a20e00640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f49fc06b040 0x7f49fc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.588+0000 7f4a20e00640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f49fc06b040 0x7f49fc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.588+0000 7f4a21800640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f49fc065150 0x7f49fc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009c60 tx=0x7f4a10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.589+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== osd.0 v2:172.21.15.46:6823/37558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f49fc06db00 con 0x7f49fc06b040 2024-08-17T02:31:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.601+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 --> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a1c168de0 con 0x7f49fc06b040 2024-08-17T02:31:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a18c00640 1 -- 172.21.15.46:0/1578281864 <== osd.0 v2:172.21.15.46:6823/37558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4a1c168de0 con 0x7f49fc06b040 2024-08-17T02:31:04.602 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:04.602 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:04.602 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f49fc06b040 msgr2=0x7f49fc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:6823/37558,v1:172.21.15.46:6824/37558] conn(0x7f49fc06b040 0x7f49fc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f49fc065150 msgr2=0x7f49fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f49fc065150 0x7f49fc067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009c60 tx=0x7f4a10008040 comp rx=0 tx=0).stop 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 msgr2=0x7f4a1c169d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 --2- 172.21.15.46:0/1578281864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a1c0b59f0 0x7f4a1c169d40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009e90 tx=0x7f4a1400b040 comp rx=0 tx=0).stop 2024-08-17T02:31:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a22200640 1 -- 172.21.15.46:0/1578281864 reap_dead start 2024-08-17T02:31:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 shutdown_connections 2024-08-17T02:31:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 >> 172.21.15.46:0/1578281864 conn(0x7f4a1c0cfdb0 msgr2=0x7f4a1c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 shutdown_connections 2024-08-17T02:31:04.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.602+0000 7f4a24200640 1 -- 172.21.15.46:0/1578281864 wait complete. 2024-08-17T02:31:04.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:31:04.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.769+0000 7f7876e00640 1 Processor -- start 2024-08-17T02:31:04.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.769+0000 7f7876e00640 1 -- start start 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7876e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78700b1440 0x7f78700caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7876e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f78700c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7876e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78700caa80 con 0x7f78701401b0 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7876e00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78700cb450 con 0x7f78700b1440 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7876e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700c9e70 con 0x7f7870140580 2024-08-17T02:31:04.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.770+0000 7f7867400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78700b1440 0x7f78700caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f78700b1440 0x7f78700caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51726/0 (socket says 172.21.15.46:51726) 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 -- 172.21.15.46:0/2131703212 learned_addr learned my addr 172.21.15.46:0/2131703212 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7874e00640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f78700c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 -- 172.21.15.46:0/2131703212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 msgr2=0x7f78700c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f78700c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 -- 172.21.15.46:0/2131703212 >> v1:172.21.15.162:6789/0 conn(0x7f78701401b0 legacy=0x7f78700b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f786f400640 1 -- 172.21.15.46:0/2131703212 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627712707 0 0) 0x7f78700caa80 con 0x7f78701401b0 2024-08-17T02:31:04.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.771+0000 7f7867400640 1 -- 172.21.15.46:0/2131703212 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700ca150 con 0x7f78700b1440 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.772+0000 7f7867400640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f78700caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7858009910 tx=0x7f78580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13cc7335583b261 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.772+0000 7f786f400640 1 -- 172.21.15.46:0/2131703212 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785802ae40 con 0x7f78700b1440 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.772+0000 7f786f400640 1 -- 172.21.15.46:0/2131703212 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858032440 con 0x7f78700b1440 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.772+0000 7f786f400640 1 -- 172.21.15.46:0/2131703212 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580327e0 con 0x7f78700b1440 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 -- 172.21.15.46:0/2131703212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 msgr2=0x7f78700caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f78700caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7858009910 tx=0x7f78580091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 -- 172.21.15.46:0/2131703212 shutdown_connections 2024-08-17T02:31:04.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f78700c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 --2- 172.21.15.46:0/2131703212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f78700caf10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 -- 172.21.15.46:0/2131703212 >> 172.21.15.46:0/2131703212 conn(0x7f78700cb9b0 msgr2=0x7f78700cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 -- 172.21.15.46:0/2131703212 shutdown_connections 2024-08-17T02:31:04.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.773+0000 7f7876e00640 1 -- 172.21.15.46:0/2131703212 wait complete. 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.774+0000 7f7876e00640 1 Processor -- start 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 -- start start 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78701401b0 0x7f7870156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f7870156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787016b420 con 0x7f78700b1440 2024-08-17T02:31:04.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787016a810 con 0x7f78701401b0 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.775+0000 7f7876e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787016aaf0 con 0x7f7870140580 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51730/0 (socket says 172.21.15.46:51730) 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 -- 172.21.15.46:0/4280723872 learned_addr learned my addr 172.21.15.46:0/4280723872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f7867400640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78701401b0 0x7f7870156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f7874e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f7870156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 -- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 msgr2=0x7f7870156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f7870156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 -- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78701401b0 msgr2=0x7f7870156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78701401b0 0x7f7870156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 -- 172.21.15.46:0/4280723872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009450 con 0x7f78700b1440 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f7874e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f7870156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.776+0000 7f786fe00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f786000c5b0 tx=0x7f7860007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.777+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860012630 con 0x7f78700b1440 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.777+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600127d0 con 0x7f78700b1440 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.777+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860012b90 con 0x7f78700b1440 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.777+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787016add0 con 0x7f78700b1440 2024-08-17T02:31:04.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.777+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78701670e0 con 0x7f78700b1440 2024-08-17T02:31:04.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.778+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870064db0 con 0x7f78700b1440 2024-08-17T02:31:04.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.779+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f786001b400 con 0x7f78700b1440 2024-08-17T02:31:04.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.780+0000 7f7867e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 0x7f784c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.780+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7860081d30 con 0x7f78700b1440 2024-08-17T02:31:04.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.780+0000 7f7867400640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 0x7f784c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.781+0000 7f7867400640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 0x7f784c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7858034000 tx=0x7f7858032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.783+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7860050090 con 0x7f78700b1440 2024-08-17T02:31:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.965+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7870167300 con 0x7f784c065150 2024-08-17T02:31:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.966+0000 7f7867e00640 1 -- 172.21.15.46:0/4280723872 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7858032770 con 0x7f784c065150 2024-08-17T02:31:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:31:04.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 msgr2=0x7f784c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 0x7f784c067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7858034000 tx=0x7f7858032000 comp rx=0 tx=0).stop 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 msgr2=0x7f787016ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f786000c5b0 tx=0x7f7860007d60 comp rx=0 tx=0).stop 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 shutdown_connections 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f784c065150 0x7f784c067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7870140580 0x7f7870156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78701401b0 0x7f7870156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 --2- 172.21.15.46:0/4280723872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78700b1440 0x7f787016ccd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 >> 172.21.15.46:0/4280723872 conn(0x7f78700cb9b0 msgr2=0x7f787013ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 shutdown_connections 2024-08-17T02:31:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:04.968+0000 7f7876e00640 1 -- 172.21.15.46:0/4280723872 wait complete. 2024-08-17T02:31:04.983 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:31:04.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:05.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.139+0000 7fa4d5000640 1 Processor -- start 2024-08-17T02:31:05.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.140+0000 7fa4d5000640 1 -- start start 2024-08-17T02:31:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4d5000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 0x7fa4d00ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4d5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4d5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d0157840 con 0x7fa4d0155c50 2024-08-17T02:31:05.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4d5000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d0156c30 con 0x7fa4d0155880 2024-08-17T02:31:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4d5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0156f10 con 0x7fa4d00aeb70 2024-08-17T02:31:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4cf400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 0x7fa4d00ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4c7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4c7e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:37752/0 (socket says 172.21.15.46:37752) 2024-08-17T02:31:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.141+0000 7fa4c7e00640 1 -- 172.21.15.46:0/859315826 learned_addr learned my addr 172.21.15.46:0/859315826 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.142+0000 7fa4c7e00640 1 -- 172.21.15.46:0/859315826 >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 msgr2=0x7fa4d00ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.142+0000 7fa4c7e00640 1 --2- 172.21.15.46:0/859315826 >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 0x7fa4d00ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.142+0000 7fa4c7e00640 1 -- 172.21.15.46:0/859315826 >> v1:172.21.15.162:6789/0 conn(0x7fa4d0155c50 legacy=0x7fa4d01596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.142+0000 7fa4c7e00640 1 -- 172.21.15.46:0/859315826 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d01571f0 con 0x7fa4d00aeb70 2024-08-17T02:31:05.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.142+0000 7fa4cf400640 1 --2- 172.21.15.46:0/859315826 >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 0x7fa4d00ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.143+0000 7fa4c7e00640 1 --2- 172.21.15.46:0/859315826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009910 tx=0x7fa4b80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89bf084c9279e473 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.143+0000 7fa4cea00640 1 -- 172.21.15.46:0/859315826 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b802ae40 con 0x7fa4d00aeb70 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.143+0000 7fa4cea00640 1 -- 172.21.15.46:0/859315826 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8032440 con 0x7fa4d00aeb70 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.143+0000 7fa4cea00640 1 -- 172.21.15.46:0/859315826 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8032820 con 0x7fa4d00aeb70 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 -- 172.21.15.46:0/859315826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 msgr2=0x7fa4d00af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 --2- 172.21.15.46:0/859315826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009910 tx=0x7fa4b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 -- 172.21.15.46:0/859315826 shutdown_connections 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 --2- 172.21.15.46:0/859315826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d00af0f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 --2- 172.21.15.46:0/859315826 >> v2:172.21.15.162:3300/0 conn(0x7fa4d0155880 0x7fa4d00ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 -- 172.21.15.46:0/859315826 >> 172.21.15.46:0/859315826 conn(0x7fa4d0067750 msgr2=0x7fa4d00cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 -- 172.21.15.46:0/859315826 shutdown_connections 2024-08-17T02:31:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.144+0000 7fa4d5000640 1 -- 172.21.15.46:0/859315826 wait complete. 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.146+0000 7fa4d5000640 1 Processor -- start 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.146+0000 7fa4d5000640 1 -- start start 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d0155880 0x7fa4d014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 0x7fa4d0151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014c470 con 0x7fa4d0155c50 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014e490 con 0x7fa4d0155880 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4d5000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014e770 con 0x7fa4d00aeb70 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 0x7fa4d0151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 0x7fa4d0151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51732/0 (socket says 172.21.15.46:51732) 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 -- 172.21.15.46:0/2706608012 learned_addr learned my addr 172.21.15.46:0/2706608012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cf400640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4c7e00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d0155880 0x7fa4d014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 -- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 msgr2=0x7fa4d015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d00aeb70 0x7fa4d015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 -- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d0155880 msgr2=0x7fa4d014bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d0155880 0x7fa4d014bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.147+0000 7fa4cfe00640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0009390 con 0x7fa4d0155c50 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4cfe00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 0x7fa4d0151e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c7c0 tx=0x7fa4c80015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800a640 con 0x7fa4d0155c50 2024-08-17T02:31:05.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800a7c0 con 0x7fa4d0155c50 2024-08-17T02:31:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b8009450 con 0x7fa4d0155c50 2024-08-17T02:31:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800ab80 con 0x7fa4d0155c50 2024-08-17T02:31:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.148+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d014eb00 con 0x7fa4d0155c50 2024-08-17T02:31:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.149+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4d0071050 con 0x7fa4d0155c50 2024-08-17T02:31:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.150+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4c8003030 con 0x7fa4d0155c50 2024-08-17T02:31:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c6a00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa4ac065150 0x7fa4ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa4c8081fe0 con 0x7fa4d0155c50 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c6a00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fa4ac06b040 0x7fa4ac06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4ac06db00 con 0x7fa4ac06b040 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4c80845c0 con 0x7fa4d0155c50 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4cf400640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa4ac065150 0x7fa4ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.151+0000 7fa4c7e00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fa4ac06b040 0x7fa4ac06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.152+0000 7fa4c7e00640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fa4ac06b040 0x7fa4ac06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.152+0000 7fa4cf400640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa4ac065150 0x7fa4ac067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009eb0 tx=0x7fa4c00090f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.153+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== osd.1 v2:172.21.15.46:6800/37552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fa4ac06db00 con 0x7fa4ac06b040 2024-08-17T02:31:05.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.165+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 --> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa4d014e930 con 0x7fa4ac06b040 2024-08-17T02:31:05.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4c6a00640 1 -- 172.21.15.46:0/2706608012 <== osd.1 v2:172.21.15.46:6800/37552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa4b80326a0 con 0x7fa4ac06b040 2024-08-17T02:31:05.166 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:05.166 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:05.166 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:05.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fa4ac06b040 msgr2=0x7fa4ac06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:6800/37552,v1:172.21.15.46:6801/37552] conn(0x7fa4ac06b040 0x7fa4ac06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa4ac065150 msgr2=0x7fa4ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fa4ac065150 0x7fa4ac067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009eb0 tx=0x7fa4c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 msgr2=0x7fa4d0151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 --2- 172.21.15.46:0/2706608012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa4d0155c50 0x7fa4d0151e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c7c0 tx=0x7fa4c80015f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4cfe00640 1 -- 172.21.15.46:0/2706608012 reap_dead start 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 shutdown_connections 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.166+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 >> 172.21.15.46:0/2706608012 conn(0x7fa4d0067750 msgr2=0x7fa4d015ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.167+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 shutdown_connections 2024-08-17T02:31:05.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.167+0000 7fa4d5000640 1 -- 172.21.15.46:0/2706608012 wait complete. 2024-08-17T02:31:05.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:31:05.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.333+0000 7f0f81000640 1 Processor -- start 2024-08-17T02:31:05.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.333+0000 7f0f81000640 1 -- start start 2024-08-17T02:31:05.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f81000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f7c069710 0x7f0f7c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f81000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c0aec20 con 0x7f0f7c0ac540 2024-08-17T02:31:05.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f81000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c0ae330 con 0x7f0f7c158bd0 2024-08-17T02:31:05.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f81000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0acd30 con 0x7f0f7c069710 2024-08-17T02:31:05.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f7be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f0f7c0ac540 0x7f0f7c0af0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40710/0 (socket says 172.21.15.46:40710) 2024-08-17T02:31:05.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.334+0000 7f0f7be00640 1 -- 172.21.15.46:0/524532120 learned_addr learned my addr 172.21.15.46:0/524532120 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:05.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f73e00640 1 --2- 172.21.15.46:0/524532120 >> v2:172.21.15.162:3300/0 conn(0x7f0f7c069710 0x7f0f7c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113278325 0 0) 0x7f0f7c0aec20 con 0x7f0f7c0ac540 2024-08-17T02:31:05.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f600034e0 con 0x7f0f7c0ac540 2024-08-17T02:31:05.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346744650 0 0) 0x7f0f600034e0 con 0x7f0f7c0ac540 2024-08-17T02:31:05.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f73e00640 1 -- 172.21.15.46:0/524532120 >> v1:172.21.15.162:6789/0 conn(0x7f0f7c158bd0 legacy=0x7f0f7c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f73e00640 1 -- 172.21.15.46:0/524532120 >> v1:172.21.15.46:6789/0 conn(0x7f0f7c0ac540 legacy=0x7f0f7c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.335+0000 7f0f73e00640 1 -- 172.21.15.46:0/524532120 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0ae5d0 con 0x7f0f7c069710 2024-08-17T02:31:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.336+0000 7f0f73e00640 1 --2- 172.21.15.46:0/524532120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c069710 0x7f0f7c0ac000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009850 tx=0x7f0f640090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d115bc6c916eac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.336+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740017f0 con 0x7f0f7c069710 2024-08-17T02:31:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.336+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6402a9c0 con 0x7f0f7c069710 2024-08-17T02:31:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.336+0000 7f0f7aa00640 1 -- 172.21.15.46:0/524532120 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6402ad60 con 0x7f0f7c069710 2024-08-17T02:31:05.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 -- 172.21.15.46:0/524532120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c069710 msgr2=0x7f0f7c0ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 --2- 172.21.15.46:0/524532120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c069710 0x7f0f7c0ac000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009850 tx=0x7f0f640090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 -- 172.21.15.46:0/524532120 shutdown_connections 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 --2- 172.21.15.46:0/524532120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c069710 0x7f0f7c0ac000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 -- 172.21.15.46:0/524532120 >> 172.21.15.46:0/524532120 conn(0x7f0f7c096a70 msgr2=0x7f0f7c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 -- 172.21.15.46:0/524532120 shutdown_connections 2024-08-17T02:31:05.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.337+0000 7f0f81000640 1 -- 172.21.15.46:0/524532120 wait complete. 2024-08-17T02:31:05.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.339+0000 7f0f81000640 1 Processor -- start 2024-08-17T02:31:05.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.339+0000 7f0f81000640 1 -- start start 2024-08-17T02:31:05.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f7c069710 0x7f0f7c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c0ac540 0x7f0f7c169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0c9520 con 0x7f0f7c158bd0 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c16a2a0 con 0x7f0f7c0ac540 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f81000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0b2990 con 0x7f0f7c069710 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51742/0 (socket says 172.21.15.46:51742) 2024-08-17T02:31:05.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 -- 172.21.15.46:0/49463399 learned_addr learned my addr 172.21.15.46:0/49463399 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7b400640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f7c069710 0x7f0f7c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f73e00640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c0ac540 0x7f0f7c169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 -- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f7c069710 msgr2=0x7f0f7c0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f7c069710 0x7f0f7c0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 -- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c0ac540 msgr2=0x7f0f7c169d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c0ac540 0x7f0f7c169d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.340+0000 7f0f7be00640 1 -- 172.21.15.46:0/49463399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009390 con 0x7f0f7c158bd0 2024-08-17T02:31:05.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f7be00640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400cc50 tx=0x7f0f74007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74004b20 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74004c80 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c0b20a0 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400aad0 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.341+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0b2620 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.343+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c0b2b00 con 0x7f0f7c158bd0 2024-08-17T02:31:05.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.343+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0f74007150 con 0x7f0f7c158bd0 2024-08-17T02:31:05.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.344+0000 7f0f72a00640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 0x7f0f58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.344+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0f74081d60 con 0x7f0f7c158bd0 2024-08-17T02:31:05.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.345+0000 7f0f7b400640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 0x7f0f58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.345+0000 7f0f7b400640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 0x7f0f58067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c158920 tx=0x7f0f6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.349+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0f74050150 con 0x7f0f7c158bd0 2024-08-17T02:31:05.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.529+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f7c071050 con 0x7f0f58065150 2024-08-17T02:31:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.530+0000 7f0f72a00640 1 -- 172.21.15.46:0/49463399 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f7c071050 con 0x7f0f58065150 2024-08-17T02:31:05.530 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:31:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 msgr2=0x7f0f58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 0x7f0f58067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c158920 tx=0x7f0f6c009040 comp rx=0 tx=0).stop 2024-08-17T02:31:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 msgr2=0x7f0f7c0c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400cc50 tx=0x7f0f74007c90 comp rx=0 tx=0).stop 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 shutdown_connections 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f7c158bd0 0x7f0f7c0c84a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f7c0ac540 0x7f0f7c169d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0f58065150 0x7f0f58067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 --2- 172.21.15.46:0/49463399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f7c069710 0x7f0f7c0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.532+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 >> 172.21.15.46:0/49463399 conn(0x7f0f7c096a70 msgr2=0x7f0f7c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.534+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 shutdown_connections 2024-08-17T02:31:05.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.534+0000 7f0f81000640 1 -- 172.21.15.46:0/49463399 wait complete. 2024-08-17T02:31:05.548 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:31:05.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.705+0000 7f1706e00640 1 Processor -- start 2024-08-17T02:31:05.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.705+0000 7f1706e00640 1 -- start start 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.706+0000 7f1706e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 0x7f17000cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.706+0000 7f1706e00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170006a2c0 con 0x7f17000c9480 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.706+0000 7f1706e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17000a9d30 con 0x7f1700158c10 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.706+0000 7f1706e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170006a510 con 0x7f17000673e0 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f1704e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f17000c9480 0x7f170006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40718/0 (socket says 172.21.15.46:40718) 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f1704e00640 1 -- 172.21.15.46:0/3020365021 learned_addr learned my addr 172.21.15.46:0/3020365021 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16ff400640 1 --2- 172.21.15.46:0/3020365021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 0x7f17000cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266458544 0 0) 0x7f170006a2c0 con 0x7f17000c9480 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e40034e0 con 0x7f17000c9480 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16ff400640 1 -- 172.21.15.46:0/3020365021 >> v1:172.21.15.162:6789/0 conn(0x7f1700158c10 legacy=0x7f1700066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830241319 0 0) 0x7f17000a9d30 con 0x7f1700158c10 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16ff400640 1 -- 172.21.15.46:0/3020365021 >> v1:172.21.15.46:6789/0 conn(0x7f17000c9480 legacy=0x7f170006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.707+0000 7f16ff400640 1 -- 172.21.15.46:0/3020365021 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170006a7f0 con 0x7f17000673e0 2024-08-17T02:31:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.708+0000 7f16ff400640 1 --2- 172.21.15.46:0/3020365021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 0x7f17000cd590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009880 tx=0x7f16ec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0e81d712a49751 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec02ae10 con 0x7f17000673e0 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec032440 con 0x7f17000673e0 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f16fea00640 1 -- 172.21.15.46:0/3020365021 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0327e0 con 0x7f17000673e0 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 -- 172.21.15.46:0/3020365021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 msgr2=0x7f17000cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 --2- 172.21.15.46:0/3020365021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 0x7f17000cd590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009880 tx=0x7f16ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 -- 172.21.15.46:0/3020365021 shutdown_connections 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 --2- 172.21.15.46:0/3020365021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17000673e0 0x7f17000cd590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 -- 172.21.15.46:0/3020365021 >> 172.21.15.46:0/3020365021 conn(0x7f17000cca80 msgr2=0x7f17000cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 -- 172.21.15.46:0/3020365021 shutdown_connections 2024-08-17T02:31:05.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.709+0000 7f1706e00640 1 -- 172.21.15.46:0/3020365021 wait complete. 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.711+0000 7f1706e00640 1 Processor -- start 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.711+0000 7f1706e00640 1 -- start start 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 0x7f1700150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17000c9480 0x7f1700157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1700158c10 0x7f1700156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700158130 con 0x7f17000673e0 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170014d940 con 0x7f17000c9480 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1706e00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170014a420 con 0x7f1700158c10 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f16ffe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 0x7f1700150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f16ffe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 0x7f1700150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51750/0 (socket says 172.21.15.46:51750) 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f16ffe00640 1 -- 172.21.15.46:0/2707630683 learned_addr learned my addr 172.21.15.46:0/2707630683 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f1704e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1700158c10 0x7f1700156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.712+0000 7f16ff400640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17000c9480 0x7f1700157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 -- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1700158c10 msgr2=0x7f1700156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1700158c10 0x7f1700156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 -- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17000c9480 msgr2=0x7f1700157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17000c9480 0x7f1700157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec009390 con 0x7f17000673e0 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16ffe00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 0x7f1700150700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c4e0 tx=0x7f16f0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012630 con 0x7f17000673e0 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00127b0 con 0x7f17000673e0 2024-08-17T02:31:05.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012b70 con 0x7f17000673e0 2024-08-17T02:31:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.713+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170014a700 con 0x7f17000673e0 2024-08-17T02:31:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.714+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170014acc0 con 0x7f17000673e0 2024-08-17T02:31:05.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.714+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17000710c0 con 0x7f17000673e0 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.715+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f16f001b400 con 0x7f17000673e0 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.716+0000 7f16f7400640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f16e0065150 0x7f16e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.716+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f16f0081c90 con 0x7f17000673e0 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f16f7400640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f16e006b040 0x7f16e006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16e006db00 con 0x7f16e006b040 2024-08-17T02:31:05.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16f0086220 con 0x7f17000673e0 2024-08-17T02:31:05.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f16ff400640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f16e0065150 0x7f16e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f1704e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f16e006b040 0x7f16e006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.717+0000 7f1704e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f16e006b040 0x7f16e006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.718+0000 7f16ff400640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f16e0065150 0x7f16e0067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f16ec034000 tx=0x7f16ec032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.718+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== osd.2 v2:172.21.15.46:6809/37554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f16e006db00 con 0x7f16e006b040 2024-08-17T02:31:05.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.731+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 --> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f17000af590 con 0x7f16e006b040 2024-08-17T02:31:05.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.731+0000 7f16f7400640 1 -- 172.21.15.46:0/2707630683 <== osd.2 v2:172.21.15.46:6809/37554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f17000af590 con 0x7f16e006b040 2024-08-17T02:31:05.731 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:05.732 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:05.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f16e006b040 msgr2=0x7f16e006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:6809/37554,v1:172.21.15.46:6811/37554] conn(0x7f16e006b040 0x7f16e006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f16e0065150 msgr2=0x7f16e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f16e0065150 0x7f16e0067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f16ec034000 tx=0x7f16ec032000 comp rx=0 tx=0).stop 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 msgr2=0x7f1700150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 --2- 172.21.15.46:0/2707630683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17000673e0 0x7f1700150700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c4e0 tx=0x7f16f0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1704e00640 1 -- 172.21.15.46:0/2707630683 reap_dead start 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 shutdown_connections 2024-08-17T02:31:05.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 >> 172.21.15.46:0/2707630683 conn(0x7f17000cca80 msgr2=0x7f17000b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 shutdown_connections 2024-08-17T02:31:05.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.732+0000 7f1706e00640 1 -- 172.21.15.46:0/2707630683 wait complete. 2024-08-17T02:31:05.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:31:05.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.898+0000 7f1413600640 1 Processor -- start 2024-08-17T02:31:05.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.898+0000 7f1413600640 1 -- start start 2024-08-17T02:31:05.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.899+0000 7f1413600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f140c155df0 0x7f140c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.899+0000 7f1413600640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c156670 con 0x7f140c06df00 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1413600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c06e5e0 con 0x7f140c155a20 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1413600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0b0350 con 0x7f140c155df0 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1411600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f140c155df0 0x7f140c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f140be00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f140c06df00 0x7f140c156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40728/0 (socket says 172.21.15.46:40728) 2024-08-17T02:31:05.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f140be00640 1 -- 172.21.15.46:0/1827708569 learned_addr learned my addr 172.21.15.46:0/1827708569 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:05.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1411600640 1 -- 172.21.15.46:0/1827708569 >> v1:172.21.15.162:6789/0 conn(0x7f140c155a20 legacy=0x7f140c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f140b400640 1 -- 172.21.15.46:0/1827708569 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075893093 0 0) 0x7f140c156670 con 0x7f140c06df00 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1411600640 1 -- 172.21.15.46:0/1827708569 >> v1:172.21.15.46:6789/0 conn(0x7f140c06df00 legacy=0x7f140c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.900+0000 7f1411600640 1 -- 172.21.15.46:0/1827708569 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c06e8c0 con 0x7f140c155df0 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.901+0000 7f1411600640 1 --2- 172.21.15.46:0/1827708569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c0adf10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e60 tx=0x7f1404009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533987ba7f170760 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f140b400640 1 -- 172.21.15.46:0/1827708569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1404007550 con 0x7f140c155df0 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f140b400640 1 -- 172.21.15.46:0/1827708569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140402d050 con 0x7f140c155df0 2024-08-17T02:31:05.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f140b400640 1 -- 172.21.15.46:0/1827708569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14040078e0 con 0x7f140c155df0 2024-08-17T02:31:05.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 -- 172.21.15.46:0/1827708569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 msgr2=0x7f140c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 --2- 172.21.15.46:0/1827708569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c0adf10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e60 tx=0x7f1404009780 comp rx=0 tx=0).stop 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 -- 172.21.15.46:0/1827708569 shutdown_connections 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 --2- 172.21.15.46:0/1827708569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c0adf10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 -- 172.21.15.46:0/1827708569 >> 172.21.15.46:0/1827708569 conn(0x7f140c0cb9b0 msgr2=0x7f140c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 -- 172.21.15.46:0/1827708569 shutdown_connections 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.902+0000 7f1413600640 1 -- 172.21.15.46:0/1827708569 wait complete. 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.904+0000 7f1413600640 1 Processor -- start 2024-08-17T02:31:05.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.904+0000 7f1413600640 1 -- start start 2024-08-17T02:31:05.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 0x7f140c169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c155a20 0x7f140c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c169ed0 con 0x7f140c155df0 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15ab90 con 0x7f140c155a20 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1413600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c14f8e0 con 0x7f140c06df00 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f140be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c155a20 0x7f140c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1411600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1410c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 0x7f140c169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1411600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c14f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51780/0 (socket says 172.21.15.46:51780) 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.905+0000 7f1411600640 1 -- 172.21.15.46:0/1865370584 learned_addr learned my addr 172.21.15.46:0/1865370584 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:05.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 -- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c155a20 msgr2=0x7f140c15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c155a20 0x7f140c15a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 -- 172.21.15.46:0/1865370584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 msgr2=0x7f140c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 -- 172.21.15.46:0/1865370584 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009a20 con 0x7f140c06df00 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1410c00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 0x7f140c169990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f140000c4e0 tx=0x7f1400007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011590 con 0x7f140c06df00 2024-08-17T02:31:05.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14000116f0 con 0x7f140c06df00 2024-08-17T02:31:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400011ab0 con 0x7f140c06df00 2024-08-17T02:31:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c1595b0 con 0x7f140c06df00 2024-08-17T02:31:05.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.906+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c159b70 con 0x7f140c06df00 2024-08-17T02:31:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.907+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c064db0 con 0x7f140c06df00 2024-08-17T02:31:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.909+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14000347a0 con 0x7f140c06df00 2024-08-17T02:31:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.909+0000 7f13ffe00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 0x7f13ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.910+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1400081630 con 0x7f140c06df00 2024-08-17T02:31:05.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.910+0000 7f140be00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 0x7f13ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.911+0000 7f140be00640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 0x7f13ec067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f13f80011e0 tx=0x7f13f8007c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:05.913+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f140004fa20 con 0x7f140c06df00 2024-08-17T02:31:06.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.094+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f140c1575b0 con 0x7f13ec065150 2024-08-17T02:31:06.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.095+0000 7f13ffe00640 1 -- 172.21.15.46:0/1865370584 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f140c1575b0 con 0x7f13ec065150 2024-08-17T02:31:06.095 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:31:06.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.096+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 msgr2=0x7f13ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.096+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 0x7f13ec067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f13f80011e0 tx=0x7f13f8007c80 comp rx=0 tx=0).stop 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.096+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 msgr2=0x7f140c169990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.096+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 0x7f140c169990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f140000c4e0 tx=0x7f1400007e30 comp rx=0 tx=0).stop 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 shutdown_connections 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f140c155df0 0x7f140c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f140c155a20 0x7f140c15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f13ec065150 0x7f13ec067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 --2- 172.21.15.46:0/1865370584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f140c06df00 0x7f140c169990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 >> 172.21.15.46:0/1865370584 conn(0x7f140c0cb9b0 msgr2=0x7f140c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 shutdown_connections 2024-08-17T02:31:06.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.097+0000 7f1413600640 1 -- 172.21.15.46:0/1865370584 wait complete. 2024-08-17T02:31:06.111 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:31:06.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:06.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.268+0000 7f024c800640 1 Processor -- start 2024-08-17T02:31:06.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.268+0000 7f024c800640 1 -- start start 2024-08-17T02:31:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0244156890 0x7f024406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 0x7f024406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02440c8130 0x7f02440c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02440ae9b0 con 0x7f02440c8130 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02440ab320 con 0x7f0244156890 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.269+0000 7f024c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02440aa730 con 0x7f0244156c60 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02440c8130 0x7f02440c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02440c8130 0x7f02440c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51792/0 (socket says 172.21.15.46:51792) 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 -- 172.21.15.46:0/2224359791 learned_addr learned my addr 172.21.15.46:0/2224359791 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f0249e00640 1 --2- 172.21.15.46:0/2224359791 >> v2:172.21.15.162:3300/0 conn(0x7f0244156890 0x7f024406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f0249400640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 0x7f024406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 -- 172.21.15.46:0/2224359791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 msgr2=0x7f024406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 0x7f024406e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 -- 172.21.15.46:0/2224359791 >> v2:172.21.15.162:3300/0 conn(0x7f0244156890 msgr2=0x7f024406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 --2- 172.21.15.46:0/2224359791 >> v2:172.21.15.162:3300/0 conn(0x7f0244156890 0x7f024406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f024a800640 1 -- 172.21.15.46:0/2224359791 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440aa9f0 con 0x7f02440c8130 2024-08-17T02:31:06.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.270+0000 7f0249400640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 0x7f024406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:06.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.271+0000 7f024a800640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02440c8130 0x7f02440c85b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f024406c5c0 tx=0x7f0240009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ccdcd9a03ee44d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f0248a00640 1 -- 172.21.15.46:0/2224359791 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240031400 con 0x7f02440c8130 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f0248a00640 1 -- 172.21.15.46:0/2224359791 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024002d050 con 0x7f02440c8130 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f0248a00640 1 -- 172.21.15.46:0/2224359791 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400317d0 con 0x7f02440c8130 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 -- 172.21.15.46:0/2224359791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02440c8130 msgr2=0x7f02440c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02440c8130 0x7f02440c85b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f024406c5c0 tx=0x7f0240009840 comp rx=0 tx=0).stop 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 -- 172.21.15.46:0/2224359791 shutdown_connections 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02440c8130 0x7f02440c85b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 --2- 172.21.15.46:0/2224359791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0244156c60 0x7f024406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 --2- 172.21.15.46:0/2224359791 >> v2:172.21.15.162:3300/0 conn(0x7f0244156890 0x7f024406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 -- 172.21.15.46:0/2224359791 >> 172.21.15.46:0/2224359791 conn(0x7f0244067750 msgr2=0x7f024406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 -- 172.21.15.46:0/2224359791 shutdown_connections 2024-08-17T02:31:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.272+0000 7f024c800640 1 -- 172.21.15.46:0/2224359791 wait complete. 2024-08-17T02:31:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.274+0000 7f024c800640 1 Processor -- start 2024-08-17T02:31:06.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.274+0000 7f024c800640 1 -- start start 2024-08-17T02:31:06.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 0x7f024414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0244156890 0x7f024414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0244156c60 0x7f024415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02441513b0 con 0x7f0244156c60 2024-08-17T02:31:06.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024415d010 con 0x7f0244156890 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024c800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024415c160 con 0x7f02440c8130 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 0x7f024414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0244156890 0x7f024414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f024a800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0244156c60 0x7f024415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 0x7f024414d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:37826/0 (socket says 172.21.15.46:37826) 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 -- 172.21.15.46:0/1280845878 learned_addr learned my addr 172.21.15.46:0/1280845878 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:06.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 -- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0244156890 msgr2=0x7f024414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0244156890 0x7f024414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 -- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0244156c60 msgr2=0x7f024415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0244156c60 0x7f024415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.275+0000 7f0249e00640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240009ae0 con 0x7f02440c8130 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f0249e00640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 0x7f024414d2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f023800ea20 tx=0x7f02380090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023800ca10 con 0x7f02440c8130 2024-08-17T02:31:06.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023800cb70 con 0x7f02440c8130 2024-08-17T02:31:06.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024415c400 con 0x7f02440c8130 2024-08-17T02:31:06.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238013470 con 0x7f02440c8130 2024-08-17T02:31:06.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.276+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024415c9c0 con 0x7f02440c8130 2024-08-17T02:31:06.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.277+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02440710c0 con 0x7f02440c8130 2024-08-17T02:31:06.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.278+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0238038970 con 0x7f02440c8130 2024-08-17T02:31:06.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.279+0000 7f023d600640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0228065150 0x7f0228067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.279+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f02380826f0 con 0x7f02440c8130 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.279+0000 7f023d600640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f022806b040 0x7f022806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.280+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f022806db00 con 0x7f022806b040 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.280+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02380829e0 con 0x7f02440c8130 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.280+0000 7f024a800640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f022806b040 0x7f022806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.280+0000 7f0249400640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0228065150 0x7f0228067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.280+0000 7f024a800640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f022806b040 0x7f022806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.281+0000 7f0249400640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0228065150 0x7f0228067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0244150d80 tx=0x7f0234008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.281+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== osd.3 v2:172.21.15.46:6808/37556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f022806db00 con 0x7f022806b040 2024-08-17T02:31:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.294+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 --> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0244070740 con 0x7f022806b040 2024-08-17T02:31:06.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f023d600640 1 -- 172.21.15.46:0/1280845878 <== osd.3 v2:172.21.15.46:6808/37556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0244070740 con 0x7f022806b040 2024-08-17T02:31:06.295 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:06.295 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:06.295 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f022806b040 msgr2=0x7f022806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.46:6808/37556,v1:172.21.15.46:6810/37556] conn(0x7f022806b040 0x7f022806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0228065150 msgr2=0x7f0228067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f0228065150 0x7f0228067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0244150d80 tx=0x7f0234008040 comp rx=0 tx=0).stop 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 msgr2=0x7f024414d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 --2- 172.21.15.46:0/1280845878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02440c8130 0x7f024414d2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f023800ea20 tx=0x7f02380090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024a800640 1 -- 172.21.15.46:0/1280845878 reap_dead start 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 shutdown_connections 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 >> 172.21.15.46:0/1280845878 conn(0x7f0244067750 msgr2=0x7f02440ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 shutdown_connections 2024-08-17T02:31:06.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.295+0000 7f024c800640 1 -- 172.21.15.46:0/1280845878 wait complete. 2024-08-17T02:31:06.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:31:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.460+0000 7f936d000640 1 Processor -- start 2024-08-17T02:31:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.461+0000 7f936d000640 1 -- start start 2024-08-17T02:31:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f936d000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ad0 0x7f93680cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f936d000640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9368156ea0 0x7f936806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f936d000640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680caaf0 con 0x7f936806dab0 2024-08-17T02:31:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f936d000640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680ca900 con 0x7f9368156ea0 2024-08-17T02:31:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f936d000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680cc560 con 0x7f9368156ad0 2024-08-17T02:31:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f935fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9368156ea0 0x7f936806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f9367e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f936806dab0 0x7f93680c8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40738/0 (socket says 172.21.15.46:40738) 2024-08-17T02:31:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f9367e00640 1 -- 172.21.15.46:0/3946286040 learned_addr learned my addr 172.21.15.46:0/3946286040 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.462+0000 7f9367400640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ad0 0x7f93680cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.463+0000 7f935fe00640 1 -- 172.21.15.46:0/3946286040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ad0 msgr2=0x7f93680cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.463+0000 7f935fe00640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ad0 0x7f93680cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.463+0000 7f935fe00640 1 -- 172.21.15.46:0/3946286040 >> v1:172.21.15.46:6789/0 conn(0x7f936806dab0 legacy=0x7f93680c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.463+0000 7f935fe00640 1 -- 172.21.15.46:0/3946286040 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680cad90 con 0x7f9368156ea0 2024-08-17T02:31:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.463+0000 7f9366a00640 1 -- 172.21.15.46:0/3946286040 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434386344 0 0) 0x7f93680caaf0 con 0x7f936806dab0 2024-08-17T02:31:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f935fe00640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ea0 0x7f936806d570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9350009880 tx=0x7f93500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6021480ad17ddd62 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f9366a00640 1 -- 172.21.15.46:0/3946286040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935002ad70 con 0x7f9368156ea0 2024-08-17T02:31:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f9366a00640 1 -- 172.21.15.46:0/3946286040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350032440 con 0x7f9368156ea0 2024-08-17T02:31:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f9366a00640 1 -- 172.21.15.46:0/3946286040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93500327e0 con 0x7f9368156ea0 2024-08-17T02:31:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f936d000640 1 -- 172.21.15.46:0/3946286040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ea0 msgr2=0x7f936806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.464+0000 7f936d000640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ea0 0x7f936806d570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9350009880 tx=0x7f93500090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 -- 172.21.15.46:0/3946286040 shutdown_connections 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ea0 0x7f936806d570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 --2- 172.21.15.46:0/3946286040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ad0 0x7f93680cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 -- 172.21.15.46:0/3946286040 >> 172.21.15.46:0/3946286040 conn(0x7f9368067750 msgr2=0x7f93680cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 -- 172.21.15.46:0/3946286040 shutdown_connections 2024-08-17T02:31:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.465+0000 7f936d000640 1 -- 172.21.15.46:0/3946286040 wait complete. 2024-08-17T02:31:06.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.466+0000 7f936d000640 1 Processor -- start 2024-08-17T02:31:06.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.466+0000 7f936d000640 1 -- start start 2024-08-17T02:31:06.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 0x7f9368150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ea0 0x7f9368069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680af4d0 con 0x7f9368156ad0 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680ae8c0 con 0x7f936806dab0 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f936d000640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680aeba0 con 0x7f9368156ea0 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f935fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f935fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51810/0 (socket says 172.21.15.46:51810) 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.467+0000 7f935fe00640 1 -- 172.21.15.46:0/3614470982 learned_addr learned my addr 172.21.15.46:0/3614470982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f9367e00640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ea0 0x7f9368069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f9367400640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 0x7f9368150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 -- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ea0 msgr2=0x7f9368069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ea0 0x7f9368069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 -- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 msgr2=0x7f9368150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 0x7f9368150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 -- 172.21.15.46:0/3614470982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009390 con 0x7f9368156ad0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f9367400640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 0x7f9368150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935fe00640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9350009880 tx=0x7f9350032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350000d10 con 0x7f9368156ad0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350031e00 con 0x7f9368156ad0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680aee80 con 0x7f9368156ad0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.468+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935003d690 con 0x7f9368156ad0 2024-08-17T02:31:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.469+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9368151480 con 0x7f9368156ad0 2024-08-17T02:31:06.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.470+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93680af680 con 0x7f9368156ad0 2024-08-17T02:31:06.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.470+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9350039040 con 0x7f9368156ad0 2024-08-17T02:31:06.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.471+0000 7f935ea00640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 0x7f9344067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.471+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f93500a24b0 con 0x7f9368156ad0 2024-08-17T02:31:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.472+0000 7f9367400640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 0x7f9344067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.472+0000 7f9367400640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 0x7f9344067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9358009cf0 tx=0x7f9358008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.475+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93680af680 con 0x7f9368156ad0 2024-08-17T02:31:06.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.660+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f93680af680 con 0x7f9344065150 2024-08-17T02:31:06.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.661+0000 7f935ea00640 1 -- 172.21.15.46:0/3614470982 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f93680af680 con 0x7f9344065150 2024-08-17T02:31:06.661 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:31:06.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 msgr2=0x7f9344067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 0x7f9344067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9358009cf0 tx=0x7f9358008040 comp rx=0 tx=0).stop 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 msgr2=0x7f93680698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9350009880 tx=0x7f9350032000 comp rx=0 tx=0).stop 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 shutdown_connections 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9344065150 0x7f9344067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9368156ea0 0x7f9368069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9368156ad0 0x7f93680698a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 --2- 172.21.15.46:0/3614470982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f936806dab0 0x7f9368150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.663+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 >> 172.21.15.46:0/3614470982 conn(0x7f9368067750 msgr2=0x7f93680682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.664+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 shutdown_connections 2024-08-17T02:31:06.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.664+0000 7f936d000640 1 -- 172.21.15.46:0/3614470982 wait complete. 2024-08-17T02:31:06.679 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:31:06.680 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.835+0000 7faedfe00640 1 Processor -- start 2024-08-17T02:31:06.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.835+0000 7faedfe00640 1 -- start start 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.836+0000 7faedfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faed8156890 0x7faed806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.836+0000 7faedfe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faed80c8840 0x7faed806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.836+0000 7faedfe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80ae9b0 con 0x7faed8156c60 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.836+0000 7faedfe00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80aa730 con 0x7faed80c8840 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.836+0000 7faedfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80aa9f0 con 0x7faed8156890 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faed80c8840 0x7faed806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faed80c8840 0x7faed806e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51814/0 (socket says 172.21.15.46:51814) 2024-08-17T02:31:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 -- 172.21.15.46:0/2648476250 learned_addr learned my addr 172.21.15.46:0/2648476250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedd400640 1 --2- 172.21.15.46:0/2648476250 >> v2:172.21.15.162:3300/0 conn(0x7faed8156890 0x7faed806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 -- 172.21.15.46:0/2648476250 >> v2:172.21.15.162:3300/0 conn(0x7faed8156890 msgr2=0x7faed806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 --2- 172.21.15.46:0/2648476250 >> v2:172.21.15.162:3300/0 conn(0x7faed8156890 0x7faed806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 -- 172.21.15.46:0/2648476250 >> v1:172.21.15.162:6789/0 conn(0x7faed8156c60 legacy=0x7faed80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.837+0000 7faedde00640 1 -- 172.21.15.46:0/2648476250 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80ab320 con 0x7faed80c8840 2024-08-17T02:31:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.838+0000 7faedde00640 1 --2- 172.21.15.46:0/2648476250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c8840 0x7faed806e420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faed806c5c0 tx=0x7faed0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c192d6fc18939ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.838+0000 7faed7e00640 1 -- 172.21.15.46:0/2648476250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007400 con 0x7faed80c8840 2024-08-17T02:31:06.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.838+0000 7faed7e00640 1 -- 172.21.15.46:0/2648476250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0007560 con 0x7faed80c8840 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.838+0000 7faed7e00640 1 -- 172.21.15.46:0/2648476250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0007940 con 0x7faed80c8840 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 -- 172.21.15.46:0/2648476250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c8840 msgr2=0x7faed806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 --2- 172.21.15.46:0/2648476250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c8840 0x7faed806e420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faed806c5c0 tx=0x7faed0009840 comp rx=0 tx=0).stop 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 -- 172.21.15.46:0/2648476250 shutdown_connections 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 --2- 172.21.15.46:0/2648476250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c8840 0x7faed806e420 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 --2- 172.21.15.46:0/2648476250 >> v2:172.21.15.162:3300/0 conn(0x7faed8156890 0x7faed806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 -- 172.21.15.46:0/2648476250 >> 172.21.15.46:0/2648476250 conn(0x7faed8067750 msgr2=0x7faed806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 -- 172.21.15.46:0/2648476250 shutdown_connections 2024-08-17T02:31:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.839+0000 7faedfe00640 1 -- 172.21.15.46:0/2648476250 wait complete. 2024-08-17T02:31:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.840+0000 7faedfe00640 1 Processor -- start 2024-08-17T02:31:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.841+0000 7faedfe00640 1 -- start start 2024-08-17T02:31:06.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.841+0000 7faedfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80c8840 0x7faed81509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 0x7faed814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedfe00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed8156c60 0x7faed813a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedfe00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8150f20 con 0x7faed8156890 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed814b510 con 0x7faed80c8840 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedfe00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed8151110 con 0x7faed8156c60 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 0x7faed814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 0x7faed814e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51826/0 (socket says 172.21.15.46:51826) 2024-08-17T02:31:06.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 -- 172.21.15.46:0/3545689107 learned_addr learned my addr 172.21.15.46:0/3545689107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedd400640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80c8840 0x7faed81509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedde00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed8156c60 0x7faed813a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 -- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed8156c60 msgr2=0x7faed813a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed8156c60 0x7faed813a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 -- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80c8840 msgr2=0x7faed81509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80c8840 0x7faed81509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.842+0000 7faedca00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009ae0 con 0x7faed8156890 2024-08-17T02:31:06.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faedca00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 0x7faed814e540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faec400c560 tx=0x7faec4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4011590 con 0x7faed8156890 2024-08-17T02:31:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec4011710 con 0x7faed8156890 2024-08-17T02:31:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec4011ad0 con 0x7faed8156890 2024-08-17T02:31:06.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed81513f0 con 0x7faed8156890 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.843+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed814ba40 con 0x7faed8156890 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.844+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faed814eae0 con 0x7faed8156890 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.845+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faec401b3b0 con 0x7faed8156890 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faed4c00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faeb8065150 0x7faeb8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7faec4081740 con 0x7faed8156890 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faed4c00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7faeb806b040 0x7faeb806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faeb806db00 con 0x7faeb806b040 2024-08-17T02:31:06.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7faec4083c40 con 0x7faed8156890 2024-08-17T02:31:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faedd400640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faeb8065150 0x7faeb8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.846+0000 7faedde00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7faeb806b040 0x7faeb806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.847+0000 7faedd400640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faeb8065150 0x7faeb8067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faecc007ba0 tx=0x7faecc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.847+0000 7faedde00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7faeb806b040 0x7faeb806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.848+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== osd.4 v2:172.21.15.162:6816/37608 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faeb806db00 con 0x7faeb806b040 2024-08-17T02:31:06.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.861+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 --> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faed80710c0 con 0x7faeb806b040 2024-08-17T02:31:06.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.862+0000 7faed4c00640 1 -- 172.21.15.46:0/3545689107 <== osd.4 v2:172.21.15.162:6816/37608 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faed80710c0 con 0x7faeb806b040 2024-08-17T02:31:06.862 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:06.862 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:06.862 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:06.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.862+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7faeb806b040 msgr2=0x7faeb806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.862+0000 7faedfe00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6816/37608,v1:172.21.15.162:6817/37608] conn(0x7faeb806b040 0x7faeb806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faeb8065150 msgr2=0x7faeb8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7faeb8065150 0x7faeb8067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faecc007ba0 tx=0x7faecc008040 comp rx=0 tx=0).stop 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 msgr2=0x7faed814e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 --2- 172.21.15.46:0/3545689107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed8156890 0x7faed814e540 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faec400c560 tx=0x7faec4007ef0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedde00640 1 -- 172.21.15.46:0/3545689107 reap_dead start 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 shutdown_connections 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 >> 172.21.15.46:0/3545689107 conn(0x7faed8067750 msgr2=0x7faed8068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 shutdown_connections 2024-08-17T02:31:06.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:06.863+0000 7faedfe00640 1 -- 172.21.15.46:0/3545689107 wait complete. 2024-08-17T02:31:06.876 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:31:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.028+0000 7fb066200640 1 Processor -- start 2024-08-17T02:31:07.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.028+0000 7fb066200640 1 -- start start 2024-08-17T02:31:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.029+0000 7fb066200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb060155a20 0x7fb0600adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.029+0000 7fb066200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb060155df0 0x7fb0600ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb066200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb06006d7f0 0x7fb06006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb066200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600b0350 con 0x7fb060155a20 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb066200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06006e1d0 con 0x7fb06006d7f0 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb066200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb060156670 con 0x7fb060155df0 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb060155a20 0x7fb0600adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb060155a20 0x7fb0600adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51834/0 (socket says 172.21.15.46:51834) 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 -- 172.21.15.46:0/82745550 learned_addr learned my addr 172.21.15.46:0/82745550 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb057e00640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb060155df0 0x7fb0600ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05fe00640 1 --2- 172.21.15.46:0/82745550 >> v2:172.21.15.162:3300/0 conn(0x7fb06006d7f0 0x7fb06006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 -- 172.21.15.46:0/82745550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb060155df0 msgr2=0x7fb0600ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb060155df0 0x7fb0600ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 -- 172.21.15.46:0/82745550 >> v2:172.21.15.162:3300/0 conn(0x7fb06006d7f0 msgr2=0x7fb06006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 --2- 172.21.15.46:0/82745550 >> v2:172.21.15.162:3300/0 conn(0x7fb06006d7f0 0x7fb06006dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.030+0000 7fb05f400640 1 -- 172.21.15.46:0/82745550 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06006e5e0 con 0x7fb060155a20 2024-08-17T02:31:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.031+0000 7fb05f400640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155a20 0x7fb0600adf10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb0601565e0 tx=0x7fb0500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1b3d67d04dbf9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb05ea00640 1 -- 172.21.15.46:0/82745550 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05002add0 con 0x7fb060155a20 2024-08-17T02:31:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb05ea00640 1 -- 172.21.15.46:0/82745550 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050032440 con 0x7fb060155a20 2024-08-17T02:31:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb05ea00640 1 -- 172.21.15.46:0/82745550 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050032820 con 0x7fb060155a20 2024-08-17T02:31:07.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 -- 172.21.15.46:0/82745550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155a20 msgr2=0x7fb0600adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155a20 0x7fb0600adf10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb0601565e0 tx=0x7fb0500091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 -- 172.21.15.46:0/82745550 shutdown_connections 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 --2- 172.21.15.46:0/82745550 >> v2:172.21.15.162:3300/0 conn(0x7fb06006d7f0 0x7fb06006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb060155df0 0x7fb0600ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 --2- 172.21.15.46:0/82745550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155a20 0x7fb0600adf10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 -- 172.21.15.46:0/82745550 >> 172.21.15.46:0/82745550 conn(0x7fb0600cb9b0 msgr2=0x7fb0600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 -- 172.21.15.46:0/82745550 shutdown_connections 2024-08-17T02:31:07.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.032+0000 7fb066200640 1 -- 172.21.15.46:0/82745550 wait complete. 2024-08-17T02:31:07.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.034+0000 7fb066200640 1 Processor -- start 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.034+0000 7fb066200640 1 -- start start 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06006d7f0 0x7fb060167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb060155a20 0x7fb0600ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb060164990 con 0x7fb060155df0 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600ad5f0 con 0x7fb060155a20 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb066200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600ab9d0 con 0x7fb06006d7f0 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb05fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb05fe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51850/0 (socket says 172.21.15.46:51850) 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb05fe00640 1 -- 172.21.15.46:0/2983887140 learned_addr learned my addr 172.21.15.46:0/2983887140 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb057e00640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb060155a20 0x7fb0600ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.035+0000 7fb05f400640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06006d7f0 0x7fb060167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 -- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06006d7f0 msgr2=0x7fb060167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06006d7f0 0x7fb060167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 -- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb060155a20 msgr2=0x7fb0600ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb060155a20 0x7fb0600ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 -- 172.21.15.46:0/2983887140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009450 con 0x7fb060155df0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb05fe00640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb058009fa0 tx=0x7fb058009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800ee60 con 0x7fb060155df0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058014420 con 0x7fb060155df0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580147e0 con 0x7fb060155df0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb060164ba0 con 0x7fb060155df0 2024-08-17T02:31:07.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.036+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb060168910 con 0x7fb060155df0 2024-08-17T02:31:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.037+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb060064db0 con 0x7fb060155df0 2024-08-17T02:31:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.038+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb058014b50 con 0x7fb060155df0 2024-08-17T02:31:07.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.039+0000 7fb056a00640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 0x7fb03c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.039+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb0580828f0 con 0x7fb060155df0 2024-08-17T02:31:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.040+0000 7fb05f400640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 0x7fb03c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.040+0000 7fb05f400640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 0x7fb03c067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb050034000 tx=0x7fb050032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.043+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb058050c60 con 0x7fb060155df0 2024-08-17T02:31:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.228+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb060164d30 con 0x7fb03c065180 2024-08-17T02:31:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.229+0000 7fb056a00640 1 -- 172.21.15.46:0/2983887140 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb060164d30 con 0x7fb03c065180 2024-08-17T02:31:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:31:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 msgr2=0x7fb03c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 0x7fb03c067630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb050034000 tx=0x7fb050032000 comp rx=0 tx=0).stop 2024-08-17T02:31:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 msgr2=0x7fb06013db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb058009fa0 tx=0x7fb058009900 comp rx=0 tx=0).stop 2024-08-17T02:31:07.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 shutdown_connections 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb060155df0 0x7fb06013db00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb060155a20 0x7fb0600ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fb03c065180 0x7fb03c067630 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 --2- 172.21.15.46:0/2983887140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06006d7f0 0x7fb060167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 >> 172.21.15.46:0/2983887140 conn(0x7fb0600cb9b0 msgr2=0x7fb060152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 shutdown_connections 2024-08-17T02:31:07.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.231+0000 7fb066200640 1 -- 172.21.15.46:0/2983887140 wait complete. 2024-08-17T02:31:07.246 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:31:07.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.402+0000 7f9b3b400640 1 Processor -- start 2024-08-17T02:31:07.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.402+0000 7f9b3b400640 1 -- start start 2024-08-17T02:31:07.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.403+0000 7f9b3b400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9b3406e5f0 0x7f9b34160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.403+0000 7f9b3b400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b341568b0 con 0x7f9b34156d40 2024-08-17T02:31:07.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.403+0000 7f9b3b400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b34150500 con 0x7f9b34150130 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.403+0000 7f9b3b400640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b34155fc0 con 0x7f9b3406e5f0 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9b3406e5f0 0x7f9b34160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9b3406e5f0 0x7f9b34160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51864/0 (socket says 172.21.15.46:51864) 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 -- 172.21.15.46:0/255949592 learned_addr learned my addr 172.21.15.46:0/255949592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b33e00640 1 --1- 172.21.15.46:0/255949592 >> v1:172.21.15.46:6789/0 conn(0x7f9b34156d40 0x7f9b3406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40750/0 (socket says 172.21.15.46:40750) 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 -- 172.21.15.46:0/255949592 >> v1:172.21.15.162:6789/0 conn(0x7f9b34150130 legacy=0x7f9b340aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 -- 172.21.15.46:0/255949592 >> v1:172.21.15.46:6789/0 conn(0x7f9b34156d40 legacy=0x7f9b3406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b39400640 1 -- 172.21.15.46:0/255949592 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340add60 con 0x7f9b3406e5f0 2024-08-17T02:31:07.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.404+0000 7f9b33400640 1 -- 172.21.15.46:0/255949592 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042430225 0 0) 0x7f9b341568b0 con 0x7f9b34156d40 2024-08-17T02:31:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.405+0000 7f9b39400640 1 --2- 172.21.15.46:0/255949592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b3406e5f0 0x7f9b34160650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009f20 tx=0x7f9b2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9975c48d1fa1a25c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.405+0000 7f9b33400640 1 -- 172.21.15.46:0/255949592 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c031400 con 0x7f9b3406e5f0 2024-08-17T02:31:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.405+0000 7f9b33400640 1 -- 172.21.15.46:0/255949592 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c02d050 con 0x7f9b3406e5f0 2024-08-17T02:31:07.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.405+0000 7f9b33400640 1 -- 172.21.15.46:0/255949592 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c031790 con 0x7f9b3406e5f0 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 -- 172.21.15.46:0/255949592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b3406e5f0 msgr2=0x7f9b34160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 --2- 172.21.15.46:0/255949592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b3406e5f0 0x7f9b34160650 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009f20 tx=0x7f9b2c009840 comp rx=0 tx=0).stop 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 -- 172.21.15.46:0/255949592 shutdown_connections 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 --2- 172.21.15.46:0/255949592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b3406e5f0 0x7f9b34160650 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 -- 172.21.15.46:0/255949592 >> 172.21.15.46:0/255949592 conn(0x7f9b34067750 msgr2=0x7f9b3406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 -- 172.21.15.46:0/255949592 shutdown_connections 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.406+0000 7f9b3b400640 1 -- 172.21.15.46:0/255949592 wait complete. 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 Processor -- start 2024-08-17T02:31:07.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 -- start start 2024-08-17T02:31:07.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b3406e5f0 0x7f9b34154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 0x7f9b3414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b34156d40 0x7f9b3414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.408+0000 7f9b3b400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340c9060 con 0x7f9b34150130 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b3b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340c9ec0 con 0x7f9b34156d40 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b3b400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340c92b0 con 0x7f9b3406e5f0 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 0x7f9b3414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 0x7f9b3414cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51878/0 (socket says 172.21.15.46:51878) 2024-08-17T02:31:07.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 -- 172.21.15.46:0/2899903490 learned_addr learned my addr 172.21.15.46:0/2899903490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b39400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b34156d40 0x7f9b3414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b38a00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b3406e5f0 0x7f9b34154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 -- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b3406e5f0 msgr2=0x7f9b34154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b3406e5f0 0x7f9b34154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 -- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b34156d40 msgr2=0x7f9b3414d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b34156d40 0x7f9b3414d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.409+0000 7f9b33e00640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009ae0 con 0x7f9b34150130 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b33e00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 0x7f9b3414cc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c520 tx=0x7f9b20007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200072e0 con 0x7f9b34150130 2024-08-17T02:31:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20007460 con 0x7f9b34150130 2024-08-17T02:31:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200047a0 con 0x7f9b34150130 2024-08-17T02:31:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b340c9590 con 0x7f9b34150130 2024-08-17T02:31:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.410+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b340c9b50 con 0x7f9b34150130 2024-08-17T02:31:07.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.411+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b34149600 con 0x7f9b34150130 2024-08-17T02:31:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.412+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b20004b90 con 0x7f9b34150130 2024-08-17T02:31:07.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.412+0000 7f9b27e00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9b14065150 0x7f9b14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9b20081620 con 0x7f9b34150130 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b27e00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7f9b1406b040 0x7f9b1406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b1406db00 con 0x7f9b1406b040 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b20083b80 con 0x7f9b34150130 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b38a00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9b14065150 0x7f9b14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.413+0000 7f9b39400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7f9b1406b040 0x7f9b1406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.414+0000 7f9b38a00640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9b14065150 0x7f9b14067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b280037d0 tx=0x7f9b28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.414+0000 7f9b39400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7f9b1406b040 0x7f9b1406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.415+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== osd.5 v2:172.21.15.162:6800/37606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9b1406db00 con 0x7f9b1406b040 2024-08-17T02:31:07.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.428+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 --> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b340710c0 con 0x7f9b1406b040 2024-08-17T02:31:07.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.428+0000 7f9b27e00640 1 -- 172.21.15.46:0/2899903490 <== osd.5 v2:172.21.15.162:6800/37606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9b340710c0 con 0x7f9b1406b040 2024-08-17T02:31:07.428 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:07.429 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:07.429 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7f9b1406b040 msgr2=0x7f9b1406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6800/37606,v1:172.21.15.162:6801/37606] conn(0x7f9b1406b040 0x7f9b1406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9b14065150 msgr2=0x7f9b14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f9b14065150 0x7f9b14067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b280037d0 tx=0x7f9b28009040 comp rx=0 tx=0).stop 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 msgr2=0x7f9b3414cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 --2- 172.21.15.46:0/2899903490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b34150130 0x7f9b3414cc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c520 tx=0x7f9b20007ef0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b39400640 1 -- 172.21.15.46:0/2899903490 reap_dead start 2024-08-17T02:31:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 shutdown_connections 2024-08-17T02:31:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 >> 172.21.15.46:0/2899903490 conn(0x7f9b34067750 msgr2=0x7f9b3406d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 shutdown_connections 2024-08-17T02:31:07.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.429+0000 7f9b3b400640 1 -- 172.21.15.46:0/2899903490 wait complete. 2024-08-17T02:31:07.443 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:31:07.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.595+0000 7f1836800640 1 Processor -- start 2024-08-17T02:31:07.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.595+0000 7f1836800640 1 -- start start 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.596+0000 7f1836800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 0x7f18300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.596+0000 7f1836800640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f183006df00 0x7f18300ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.596+0000 7f1836800640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1830156670 con 0x7f1830155df0 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.596+0000 7f1836800640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300b0350 con 0x7f183006df00 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.596+0000 7f1836800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183006e5e0 con 0x7f1830155a20 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f183006df00 0x7f18300ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f183006df00 0x7f18300ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51892/0 (socket says 172.21.15.46:51892) 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 -- 172.21.15.46:0/3995764844 learned_addr learned my addr 172.21.15.46:0/3995764844 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182ea00640 1 --1- 172.21.15.46:0/3995764844 >> v1:172.21.15.46:6789/0 conn(0x7f1830155df0 0x7f183006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40756/0 (socket says 172.21.15.46:40756) 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182f400640 1 --2- 172.21.15.46:0/3995764844 >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 0x7f18300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 -- 172.21.15.46:0/3995764844 >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 msgr2=0x7f18300adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 --2- 172.21.15.46:0/3995764844 >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 0x7f18300adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 -- 172.21.15.46:0/3995764844 >> v1:172.21.15.46:6789/0 conn(0x7f1830155df0 legacy=0x7f183006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182e000640 1 -- 172.21.15.46:0/3995764844 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892406647 0 0) 0x7f1830156670 con 0x7f1830155df0 2024-08-17T02:31:07.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182fe00640 1 -- 172.21.15.46:0/3995764844 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183006e8c0 con 0x7f183006df00 2024-08-17T02:31:07.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.597+0000 7f182f400640 1 --2- 172.21.15.46:0/3995764844 >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 0x7f18300adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.598+0000 7f182fe00640 1 --2- 172.21.15.46:0/3995764844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300ad9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f183006bc00 tx=0x7f1828009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc16303039386de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.598+0000 7f182e000640 1 -- 172.21.15.46:0/3995764844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828031400 con 0x7f183006df00 2024-08-17T02:31:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.598+0000 7f182e000640 1 -- 172.21.15.46:0/3995764844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182802d050 con 0x7f183006df00 2024-08-17T02:31:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.598+0000 7f182e000640 1 -- 172.21.15.46:0/3995764844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1828031790 con 0x7f183006df00 2024-08-17T02:31:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 -- 172.21.15.46:0/3995764844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 msgr2=0x7f18300ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 --2- 172.21.15.46:0/3995764844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300ad9b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f183006bc00 tx=0x7f1828009840 comp rx=0 tx=0).stop 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 -- 172.21.15.46:0/3995764844 shutdown_connections 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 --2- 172.21.15.46:0/3995764844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300ad9b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 --2- 172.21.15.46:0/3995764844 >> v2:172.21.15.162:3300/0 conn(0x7f1830155a20 0x7f18300adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 -- 172.21.15.46:0/3995764844 >> 172.21.15.46:0/3995764844 conn(0x7f18300cb9b0 msgr2=0x7f18300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 -- 172.21.15.46:0/3995764844 shutdown_connections 2024-08-17T02:31:07.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.599+0000 7f1836800640 1 -- 172.21.15.46:0/3995764844 wait complete. 2024-08-17T02:31:07.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.600+0000 7f1836800640 1 Processor -- start 2024-08-17T02:31:07.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 -- start start 2024-08-17T02:31:07.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1830155a20 0x7f18300ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 0x7f183014fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830150ab0 con 0x7f183006df00 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830150d90 con 0x7f1830155df0 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.601+0000 7f1836800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830151070 con 0x7f1830155a20 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51904/0 (socket says 172.21.15.46:51904) 2024-08-17T02:31:07.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 -- 172.21.15.46:0/333887249 learned_addr learned my addr 172.21.15.46:0/333887249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182fe00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 0x7f183014fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182ea00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1830155a20 0x7f18300ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 -- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1830155a20 msgr2=0x7f18300ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1830155a20 0x7f18300ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 -- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 msgr2=0x7f183014fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 0x7f183014fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 -- 172.21.15.46:0/333887249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009ae0 con 0x7f183006df00 2024-08-17T02:31:07.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182fe00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 0x7f183014fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.602+0000 7f182f400640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f182000d890 tx=0x7f1820008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.603+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000de80 con 0x7f183006df00 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.603+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000b8d0 con 0x7f183006df00 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.603+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000bc90 con 0x7f183006df00 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.603+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830151350 con 0x7f183006df00 2024-08-17T02:31:07.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.603+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18301502c0 con 0x7f183006df00 2024-08-17T02:31:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.604+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830064db0 con 0x7f183006df00 2024-08-17T02:31:07.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.605+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f182001e460 con 0x7f183006df00 2024-08-17T02:31:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.606+0000 7f1826a00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 0x7f1810067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.606+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f18200828b0 con 0x7f183006df00 2024-08-17T02:31:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.606+0000 7f182ea00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 0x7f1810067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.607+0000 7f182ea00640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 0x7f1810067700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1830151a30 tx=0x7f181c007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.610+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1820050cb0 con 0x7f183006df00 2024-08-17T02:31:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.788+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f183006dbe0 con 0x7f1810065250 2024-08-17T02:31:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.789+0000 7f1826a00640 1 -- 172.21.15.46:0/333887249 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f183006dbe0 con 0x7f1810065250 2024-08-17T02:31:07.789 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:31:07.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 msgr2=0x7f1810067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 0x7f1810067700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1830151a30 tx=0x7f181c007d80 comp rx=0 tx=0).stop 2024-08-17T02:31:07.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 msgr2=0x7f18300acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f182000d890 tx=0x7f1820008040 comp rx=0 tx=0).stop 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 shutdown_connections 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1830155df0 0x7f183014fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f1810065250 0x7f1810067700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1830155a20 0x7f18300ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 --2- 172.21.15.46:0/333887249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f183006df00 0x7f18300acdb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 >> 172.21.15.46:0/333887249 conn(0x7f18300cb9b0 msgr2=0x7f18300cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 shutdown_connections 2024-08-17T02:31:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.791+0000 7f1836800640 1 -- 172.21.15.46:0/333887249 wait complete. 2024-08-17T02:31:07.806 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:31:07.807 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:07.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.961+0000 7f526ee00640 1 Processor -- start 2024-08-17T02:31:07.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.961+0000 7f526ee00640 1 -- start start 2024-08-17T02:31:07.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.962+0000 7f526ee00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5268150130 0x7f52680aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.962+0000 7f526ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5268156d40 0x7f526806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.962+0000 7f526ee00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52681568b0 con 0x7f526806e420 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.962+0000 7f526ee00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526806e8a0 con 0x7f5268150130 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.962+0000 7f526ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5268150500 con 0x7f5268156d40 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5268150130 0x7f52680aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5268150130 0x7f52680aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51910/0 (socket says 172.21.15.46:51910) 2024-08-17T02:31:07.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 -- 172.21.15.46:0/1304717882 learned_addr learned my addr 172.21.15.46:0/1304717882 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267400640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5268156d40 0x7f526806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 -- 172.21.15.46:0/1304717882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5268156d40 msgr2=0x7f526806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5268156d40 0x7f526806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 -- 172.21.15.46:0/1304717882 >> v1:172.21.15.162:6789/0 conn(0x7f526806e420 legacy=0x7f52680afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.963+0000 7f5267e00640 1 -- 172.21.15.46:0/1304717882 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268155fc0 con 0x7f5268150130 2024-08-17T02:31:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.964+0000 7f5267e00640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268150130 0x7f52680aa730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5258009910 tx=0x7f52580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64716a1e1217b5f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.964+0000 7f5266a00640 1 -- 172.21.15.46:0/1304717882 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525802adb0 con 0x7f5268150130 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f5266a00640 1 -- 172.21.15.46:0/1304717882 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258032440 con 0x7f5268150130 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f5266a00640 1 -- 172.21.15.46:0/1304717882 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258032820 con 0x7f5268150130 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 -- 172.21.15.46:0/1304717882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268150130 msgr2=0x7f52680aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268150130 0x7f52680aa730 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5258009910 tx=0x7f52580091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 -- 172.21.15.46:0/1304717882 shutdown_connections 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5268156d40 0x7f526806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 --2- 172.21.15.46:0/1304717882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268150130 0x7f52680aa730 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 -- 172.21.15.46:0/1304717882 >> 172.21.15.46:0/1304717882 conn(0x7f5268067750 msgr2=0x7f526806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 -- 172.21.15.46:0/1304717882 shutdown_connections 2024-08-17T02:31:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.965+0000 7f526ee00640 1 -- 172.21.15.46:0/1304717882 wait complete. 2024-08-17T02:31:07.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.967+0000 7f526ee00640 1 Processor -- start 2024-08-17T02:31:07.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.967+0000 7f526ee00640 1 -- start start 2024-08-17T02:31:07.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 0x7f52680a7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268150130 0x7f52680a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268156d40 0x7f52680a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c90b0 con 0x7f5268156d40 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680a6420 con 0x7f5268150130 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ee00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680a6650 con 0x7f526806e420 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f5267e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 0x7f52680a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268156d40 0x7f52680a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f5267e00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 0x7f52680a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.46:37878/0 (socket says 172.21.15.46:37878) 2024-08-17T02:31:07.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f5267e00640 1 -- 172.21.15.46:0/2723334636 learned_addr learned my addr 172.21.15.46:0/2723334636 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f5267400640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268150130 0x7f52680a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 -- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 msgr2=0x7f52680a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 0x7f52680a7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 -- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268150130 msgr2=0x7f52680a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5268150130 0x7f52680a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f526ce00640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258009450 con 0x7f5268156d40 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.968+0000 7f5267e00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526806e420 0x7f52680a7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:07.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f526ce00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268156d40 0x7f52680a8a50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f526000c790 tx=0x7f5260001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000a640 con 0x7f5268156d40 2024-08-17T02:31:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000a7a0 con 0x7f5268156d40 2024-08-17T02:31:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000ab60 con 0x7f5268156d40 2024-08-17T02:31:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52680c9320 con 0x7f5268156d40 2024-08-17T02:31:07.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.969+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52680a8f90 con 0x7f5268156d40 2024-08-17T02:31:07.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.970+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52680c96f0 con 0x7f5268156d40 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.971+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5260012420 con 0x7f5268156d40 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f525f400640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5248065150 0x7f5248067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5260082320 con 0x7f5268156d40 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f525f400640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f524806b040 0x7f524806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f524806db00 con 0x7f524806b040 2024-08-17T02:31:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5260084880 con 0x7f5268156d40 2024-08-17T02:31:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.972+0000 7f5267e00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5248065150 0x7f5248067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.973+0000 7f5267400640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f524806b040 0x7f524806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.973+0000 7f5267400640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f524806b040 0x7f524806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.973+0000 7f5267e00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5248065150 0x7f5248067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5258009910 tx=0x7f5258032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.974+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== osd.6 v2:172.21.15.162:6808/37607 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f524806db00 con 0x7f524806b040 2024-08-17T02:31:07.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.987+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 --> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f526806ca60 con 0x7f524806b040 2024-08-17T02:31:07.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.988+0000 7f525f400640 1 -- 172.21.15.46:0/2723334636 <== osd.6 v2:172.21.15.162:6808/37607 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f526806ca60 con 0x7f524806b040 2024-08-17T02:31:07.988 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:07.988 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:07.988 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:07.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.988+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f524806b040 msgr2=0x7f524806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.988+0000 7f526ee00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6808/37607,v1:172.21.15.162:6809/37607] conn(0x7f524806b040 0x7f524806d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5248065150 msgr2=0x7f5248067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f5248065150 0x7f5248067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5258009910 tx=0x7f5258032000 comp rx=0 tx=0).stop 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268156d40 msgr2=0x7f52680a8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 --2- 172.21.15.46:0/2723334636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5268156d40 0x7f52680a8a50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f526000c790 tx=0x7f5260001610 comp rx=0 tx=0).stop 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ce00640 1 -- 172.21.15.46:0/2723334636 reap_dead start 2024-08-17T02:31:07.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 shutdown_connections 2024-08-17T02:31:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 >> 172.21.15.46:0/2723334636 conn(0x7f5268067750 msgr2=0x7f52680687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 shutdown_connections 2024-08-17T02:31:07.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:07.989+0000 7f526ee00640 1 -- 172.21.15.46:0/2723334636 wait complete. 2024-08-17T02:31:08.002 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:31:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.154+0000 7f15c7200640 1 Processor -- start 2024-08-17T02:31:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.154+0000 7f15c7200640 1 -- start start 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c7200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f15c0155df0 0x7f15c00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c7200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c0156670 con 0x7f15c006df00 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c7200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c006e5e0 con 0x7f15c0155a20 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c7200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c00b0350 con 0x7f15c0155df0 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15b7e00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f15c006df00 0x7f15c0156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40766/0 (socket says 172.21.15.46:40766) 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15b7e00640 1 -- 172.21.15.46:0/4192556087 learned_addr learned my addr 172.21.15.46:0/4192556087 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c5200640 1 --2- 172.21.15.46:0/4192556087 >> v2:172.21.15.46:3300/0 conn(0x7f15c0155df0 0x7f15c00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c5200640 1 -- 172.21.15.46:0/4192556087 >> v1:172.21.15.162:6789/0 conn(0x7f15c0155a20 legacy=0x7f15c006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c5200640 1 -- 172.21.15.46:0/4192556087 >> v1:172.21.15.46:6789/0 conn(0x7f15c006df00 legacy=0x7f15c0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15c5200640 1 -- 172.21.15.46:0/4192556087 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c006e8c0 con 0x7f15c0155df0 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.156+0000 7f15bf400640 1 -- 172.21.15.46:0/4192556087 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029052654 0 0) 0x7f15c0156670 con 0x7f15c006df00 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.157+0000 7f15c5200640 1 --2- 172.21.15.46:0/4192556087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c0155df0 0x7f15c00adf10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009e60 tx=0x7f15b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c3b7bbff9ab061 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15bf400640 1 -- 172.21.15.46:0/4192556087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8007550 con 0x7f15c0155df0 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15bf400640 1 -- 172.21.15.46:0/4192556087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b802d050 con 0x7f15c0155df0 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15bf400640 1 -- 172.21.15.46:0/4192556087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80078e0 con 0x7f15c0155df0 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 -- 172.21.15.46:0/4192556087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c0155df0 msgr2=0x7f15c00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 --2- 172.21.15.46:0/4192556087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c0155df0 0x7f15c00adf10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009e60 tx=0x7f15b8009780 comp rx=0 tx=0).stop 2024-08-17T02:31:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 -- 172.21.15.46:0/4192556087 shutdown_connections 2024-08-17T02:31:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 --2- 172.21.15.46:0/4192556087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c0155df0 0x7f15c00adf10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 -- 172.21.15.46:0/4192556087 >> 172.21.15.46:0/4192556087 conn(0x7f15c00cb9b0 msgr2=0x7f15c00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 -- 172.21.15.46:0/4192556087 shutdown_connections 2024-08-17T02:31:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.158+0000 7f15c7200640 1 -- 172.21.15.46:0/4192556087 wait complete. 2024-08-17T02:31:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.160+0000 7f15c7200640 1 Processor -- start 2024-08-17T02:31:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.160+0000 7f15c7200640 1 -- start start 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 0x7f15c00691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 0x7f15c0145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c006a170 con 0x7f15c006df00 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0069720 con 0x7f15c0155df0 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c7200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0145970 con 0x7f15c0155a20 2024-08-17T02:31:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51940/0 (socket says 172.21.15.46:51940) 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 -- 172.21.15.46:0/3970047886 learned_addr learned my addr 172.21.15.46:0/3970047886 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 -- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 msgr2=0x7f15c00691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15b7e00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 0x7f15c00691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15c5200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 0x7f15c0145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 0x7f15c00691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 -- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 msgr2=0x7f15c0145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 0x7f15c0145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.161+0000 7f15bfe00640 1 -- 172.21.15.46:0/3970047886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009a20 con 0x7f15c006df00 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15b7e00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 0x7f15c00691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15c5200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 0x7f15c0145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15bfe00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c560 tx=0x7f15b0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011590 con 0x7f15c006df00 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0011710 con 0x7f15c006df00 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011ad0 con 0x7f15c006df00 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c0169330 con 0x7f15c006df00 2024-08-17T02:31:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.162+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01698f0 con 0x7f15c006df00 2024-08-17T02:31:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.163+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c0064db0 con 0x7f15c006df00 2024-08-17T02:31:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.164+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f15b001b3b0 con 0x7f15c006df00 2024-08-17T02:31:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.165+0000 7f15b7400640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 0x7f159c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.165+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f15b0081750 con 0x7f15c006df00 2024-08-17T02:31:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.165+0000 7f15b7e00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 0x7f159c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.166+0000 7f15b7e00640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 0x7f159c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15c015d580 tx=0x7f15a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.169+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f15b004fab0 con 0x7f15c006df00 2024-08-17T02:31:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.350+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f15c0158940 con 0x7f159c065150 2024-08-17T02:31:08.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.351+0000 7f15b7400640 1 -- 172.21.15.46:0/3970047886 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f15c0158940 con 0x7f159c065150 2024-08-17T02:31:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:31:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 msgr2=0x7f159c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 0x7f159c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f15c015d580 tx=0x7f15a8009040 comp rx=0 tx=0).stop 2024-08-17T02:31:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 msgr2=0x7f15c0069ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c560 tx=0x7f15b0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 shutdown_connections 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15c0155df0 0x7f15c0145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f159c065150 0x7f159c067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15c0155a20 0x7f15c00691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 --2- 172.21.15.46:0/3970047886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15c006df00 0x7f15c0069ad0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 >> 172.21.15.46:0/3970047886 conn(0x7f15c00cb9b0 msgr2=0x7f15c0157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 shutdown_connections 2024-08-17T02:31:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.353+0000 7f15c7200640 1 -- 172.21.15.46:0/3970047886 wait complete. 2024-08-17T02:31:08.367 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:31:08.367 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.524+0000 7f95d4600640 1 Processor -- start 2024-08-17T02:31:08.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.524+0000 7f95d4600640 1 -- start start 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.525+0000 7f95d4600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.525+0000 7f95d4600640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95cc156c60 0x7f95cc06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.525+0000 7f95d4600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0ae9b0 con 0x7f95cc0c8130 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.525+0000 7f95d4600640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0aa730 con 0x7f95cc156c60 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.525+0000 7f95d4600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0aa9f0 con 0x7f95cc156890 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95cc156c60 0x7f95cc06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f95cc156c60 0x7f95cc06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51944/0 (socket says 172.21.15.46:51944) 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 -- 172.21.15.46:0/4101154702 learned_addr learned my addr 172.21.15.46:0/4101154702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1c00640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 -- 172.21.15.46:0/4101154702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 msgr2=0x7f95cc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 -- 172.21.15.46:0/4101154702 >> v1:172.21.15.162:6789/0 conn(0x7f95cc0c8130 legacy=0x7f95cc0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:08.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.526+0000 7f95d1200640 1 -- 172.21.15.46:0/4101154702 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0ab320 con 0x7f95cc156c60 2024-08-17T02:31:08.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.527+0000 7f95d1200640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc06e420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009910 tx=0x7f95b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90a84989ee80e59 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.527+0000 7f95cbe00640 1 -- 172.21.15.46:0/4101154702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b802ad20 con 0x7f95cc156c60 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.527+0000 7f95cbe00640 1 -- 172.21.15.46:0/4101154702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b802ae80 con 0x7f95cc156c60 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.527+0000 7f95cbe00640 1 -- 172.21.15.46:0/4101154702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8032670 con 0x7f95cc156c60 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 -- 172.21.15.46:0/4101154702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 msgr2=0x7f95cc06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc06e420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009910 tx=0x7f95b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 -- 172.21.15.46:0/4101154702 shutdown_connections 2024-08-17T02:31:08.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc06e420 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 --2- 172.21.15.46:0/4101154702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 -- 172.21.15.46:0/4101154702 >> 172.21.15.46:0/4101154702 conn(0x7f95cc067750 msgr2=0x7f95cc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 -- 172.21.15.46:0/4101154702 shutdown_connections 2024-08-17T02:31:08.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.528+0000 7f95d4600640 1 -- 172.21.15.46:0/4101154702 wait complete. 2024-08-17T02:31:08.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.529+0000 7f95d4600640 1 Processor -- start 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.530+0000 7f95d4600640 1 -- start start 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.530+0000 7f95d4600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95cc0c8130 0x7f95cc0a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d4600640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d4600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d4600640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0a8b50 con 0x7f95cc156c60 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d4600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0a8e30 con 0x7f95cc0c8130 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d4600640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0a9110 con 0x7f95cc156890 2024-08-17T02:31:08.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51954/0 (socket says 172.21.15.46:51954) 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 -- 172.21.15.46:0/1475639592 learned_addr learned my addr 172.21.15.46:0/1475639592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d1200640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d1c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95cc0c8130 0x7f95cc0a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 -- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 msgr2=0x7f95cc0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 -- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95cc0c8130 msgr2=0x7f95cc0a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95cc0c8130 0x7f95cc0a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d2600640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009450 con 0x7f95cc156c60 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d1c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95cc0c8130 0x7f95cc0a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.531+0000 7f95d1200640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95cc156890 0x7f95cc0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95d2600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc143180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c890 tx=0x7f95c4002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ce80 con 0x7f95cc156c60 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c400a7f0 con 0x7f95cc156c60 2024-08-17T02:31:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400abf0 con 0x7f95cc156c60 2024-08-17T02:31:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc0a93f0 con 0x7f95cc156c60 2024-08-17T02:31:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.532+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc0c0b30 con 0x7f95cc156c60 2024-08-17T02:31:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.533+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95cc0710c0 con 0x7f95cc156c60 2024-08-17T02:31:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.534+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95c400ad50 con 0x7f95cc156c60 2024-08-17T02:31:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.534+0000 7f95c8c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95ac065150 0x7f95ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f95c4082640 con 0x7f95cc156c60 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95c8c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f95ac06b040 0x7f95ac06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95ac06db00 con 0x7f95ac06b040 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c4084b40 con 0x7f95cc156c60 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95d1c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95ac065150 0x7f95ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.535+0000 7f95d1200640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f95ac06b040 0x7f95ac06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.536+0000 7f95d1c00640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95ac065150 0x7f95ac067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95c000bb80 tx=0x7f95c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.536+0000 7f95d1200640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f95ac06b040 0x7f95ac06d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.537+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== osd.7 v2:172.21.15.162:6824/37634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f95ac06db00 con 0x7f95ac06b040 2024-08-17T02:31:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.550+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 --> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95cc070740 con 0x7f95ac06b040 2024-08-17T02:31:08.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95c8c00640 1 -- 172.21.15.46:0/1475639592 <== osd.7 v2:172.21.15.162:6824/37634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f95cc070740 con 0x7f95ac06b040 2024-08-17T02:31:08.551 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-08-17T02:31:08.551 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:08.551 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-08-17T02:31:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f95ac06b040 msgr2=0x7f95ac06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6824/37634,v1:172.21.15.162:6825/37634] conn(0x7f95ac06b040 0x7f95ac06d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95ac065150 msgr2=0x7f95ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f95ac065150 0x7f95ac067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95c000bb80 tx=0x7f95c0008040 comp rx=0 tx=0).stop 2024-08-17T02:31:08.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 msgr2=0x7f95cc143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 --2- 172.21.15.46:0/1475639592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95cc156c60 0x7f95cc143180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c890 tx=0x7f95c4002640 comp rx=0 tx=0).stop 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d2600640 1 -- 172.21.15.46:0/1475639592 reap_dead start 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 shutdown_connections 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.551+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 >> 172.21.15.46:0/1475639592 conn(0x7f95cc067750 msgr2=0x7f95cc155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.552+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 shutdown_connections 2024-08-17T02:31:08.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.552+0000 7f95d4600640 1 -- 172.21.15.46:0/1475639592 wait complete. 2024-08-17T02:31:08.566 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:31:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.718+0000 7fdbb9a00640 1 Processor -- start 2024-08-17T02:31:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.718+0000 7fdbb9a00640 1 -- start start 2024-08-17T02:31:08.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.719+0000 7fdbb9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 0x7fdbb40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb9a00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb4156670 con 0x7fdbb4155a20 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb9a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb406e5e0 con 0x7fdbb4155df0 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40b0350 con 0x7fdbb406df00 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb2a00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fdbb4155a20 0x7fdbb406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40772/0 (socket says 172.21.15.46:40772) 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb2a00640 1 -- 172.21.15.46:0/452735759 learned_addr learned my addr 172.21.15.46:0/452735759 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb2000640 1 --2- 172.21.15.46:0/452735759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 0x7fdbb40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283116827 0 0) 0x7fdbb4156670 con 0x7fdbb4155a20 2024-08-17T02:31:08.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb980034e0 con 0x7fdbb4155a20 2024-08-17T02:31:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282408291 0 0) 0x7fdbb406e5e0 con 0x7fdbb4155df0 2024-08-17T02:31:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.720+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb4156670 con 0x7fdbb4155df0 2024-08-17T02:31:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.721+0000 7fdbb2000640 1 -- 172.21.15.46:0/452735759 >> v1:172.21.15.162:6789/0 conn(0x7fdbb4155df0 legacy=0x7fdbb4156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.721+0000 7fdbb2000640 1 -- 172.21.15.46:0/452735759 >> v1:172.21.15.46:6789/0 conn(0x7fdbb4155a20 legacy=0x7fdbb406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.721+0000 7fdbb2000640 1 -- 172.21.15.46:0/452735759 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb406e8c0 con 0x7fdbb406df00 2024-08-17T02:31:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.722+0000 7fdbb2000640 1 --2- 172.21.15.46:0/452735759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 0x7fdbb40adf10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009880 tx=0x7fdba00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6567773141ea865 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.722+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba002ae10 con 0x7fdbb406df00 2024-08-17T02:31:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.722+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0032440 con 0x7fdbb406df00 2024-08-17T02:31:08.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.722+0000 7fdbb1600640 1 -- 172.21.15.46:0/452735759 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00327e0 con 0x7fdbb406df00 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 -- 172.21.15.46:0/452735759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 msgr2=0x7fdbb40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/452735759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 0x7fdbb40adf10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009880 tx=0x7fdba00090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 -- 172.21.15.46:0/452735759 shutdown_connections 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/452735759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb406df00 0x7fdbb40adf10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 -- 172.21.15.46:0/452735759 >> 172.21.15.46:0/452735759 conn(0x7fdbb40cb9b0 msgr2=0x7fdbb40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 -- 172.21.15.46:0/452735759 shutdown_connections 2024-08-17T02:31:08.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.723+0000 7fdbb9a00640 1 -- 172.21.15.46:0/452735759 wait complete. 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.724+0000 7fdbb9a00640 1 Processor -- start 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.724+0000 7fdbb9a00640 1 -- start start 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 0x7fdbb414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 0x7fdbb40692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ae240 con 0x7fdbb4155df0 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ad630 con 0x7fdbb406df00 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.725+0000 7fdbb9a00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ad910 con 0x7fdbb4155a20 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51970/0 (socket says 172.21.15.46:51970) 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 -- 172.21.15.46:0/1105473006 learned_addr learned my addr 172.21.15.46:0/1105473006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb2000640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 0x7fdbb40692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb2a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 0x7fdbb414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 -- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 msgr2=0x7fdbb40692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 0x7fdbb40692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 -- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 msgr2=0x7fdbb414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 0x7fdbb414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 -- 172.21.15.46:0/1105473006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0009390 con 0x7fdbb4155df0 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb2000640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 0x7fdbb40692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb2a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 0x7fdbb414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbb3400640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c810 tx=0x7fdbac002650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.726+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00a640 con 0x7fdbb4155df0 2024-08-17T02:31:08.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.727+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac00a7a0 con 0x7fdbb4155df0 2024-08-17T02:31:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.727+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb40adbf0 con 0x7fdbb4155df0 2024-08-17T02:31:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.727+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00ab40 con 0x7fdbb4155df0 2024-08-17T02:31:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.727+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb414fd40 con 0x7fdbb4155df0 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.728+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb4064db0 con 0x7fdbb4155df0 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.728+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdbac012420 con 0x7fdbb4155df0 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.729+0000 7fdbaa000640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 0x7fdb94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.729+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdbac082590 con 0x7fdbb4155df0 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.730+0000 7fdbb2a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 0x7fdb94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.730+0000 7fdbb2a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 0x7fdb94067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.733+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdbac050850 con 0x7fdbb4155df0 2024-08-17T02:31:08.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.915+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbb40c09a0 con 0x7fdb94065150 2024-08-17T02:31:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.916+0000 7fdbaa000640 1 -- 172.21.15.46:0/1105473006 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdbb40c09a0 con 0x7fdb94065150 2024-08-17T02:31:08.916 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:31:08.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 msgr2=0x7fdb94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 0x7fdb94067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4009040 comp rx=0 tx=0).stop 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 msgr2=0x7fdbb4069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c810 tx=0x7fdbac002650 comp rx=0 tx=0).stop 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 shutdown_connections 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbb4155df0 0x7fdbb4069830 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdb94065150 0x7fdb94067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb4155a20 0x7fdbb40692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 --2- 172.21.15.46:0/1105473006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb406df00 0x7fdbb414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.918+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 >> 172.21.15.46:0/1105473006 conn(0x7fdbb40cb9b0 msgr2=0x7fdbb4154700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.919+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 shutdown_connections 2024-08-17T02:31:08.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:08.919+0000 7fdbb9a00640 1 -- 172.21.15.46:0/1105473006 wait complete. 2024-08-17T02:31:08.933 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.086+0000 7fdad6c00640 1 Processor -- start 2024-08-17T02:31:09.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.086+0000 7fdad6c00640 1 -- start start 2024-08-17T02:31:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdad0158ad0 0x7fdad00ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad0067d60 con 0x7fdad0158ea0 2024-08-17T02:31:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00aca30 con 0x7fdad0158ad0 2024-08-17T02:31:09.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0068600 con 0x7fdad00ac5b0 2024-08-17T02:31:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdad0158ad0 0x7fdad00ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.087+0000 7fdad6200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdad0158ad0 0x7fdad00ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.46:51572/0 (socket says 172.21.15.46:51572) 2024-08-17T02:31:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 -- 172.21.15.46:0/1114264027 learned_addr learned my addr 172.21.15.46:0/1114264027 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:09.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad4e00640 1 --1- 172.21.15.46:0/1114264027 >> v1:172.21.15.162:6789/0 conn(0x7fdad0158ea0 0x7fdad00af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.46:32998/0 (socket says 172.21.15.46:32998) 2024-08-17T02:31:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 -- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 msgr2=0x7fdad00afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 --2- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 -- 172.21.15.46:0/1114264027 >> v1:172.21.15.162:6789/0 conn(0x7fdad0158ea0 legacy=0x7fdad00af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.088+0000 7fdad5800640 1 -- 172.21.15.46:0/1114264027 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00b01d0 con 0x7fdad0158ad0 2024-08-17T02:31:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.089+0000 7fdad5800640 1 --2- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad00ac070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009910 tx=0x7fdac40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a54d451052b2f13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.089+0000 7fdacfe00640 1 -- 172.21.15.46:0/1114264027 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac402ad20 con 0x7fdad0158ad0 2024-08-17T02:31:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.089+0000 7fdacfe00640 1 -- 172.21.15.46:0/1114264027 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac402ae80 con 0x7fdad0158ad0 2024-08-17T02:31:09.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdacfe00640 1 -- 172.21.15.46:0/1114264027 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4032670 con 0x7fdad0158ad0 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 -- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 msgr2=0x7fdad00ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 --2- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad00ac070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009910 tx=0x7fdac40091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 -- 172.21.15.46:0/1114264027 shutdown_connections 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 --2- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 --2- 172.21.15.46:0/1114264027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad00ac070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 -- 172.21.15.46:0/1114264027 >> 172.21.15.46:0/1114264027 conn(0x7fdad0096a70 msgr2=0x7fdad0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 -- 172.21.15.46:0/1114264027 shutdown_connections 2024-08-17T02:31:09.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.090+0000 7fdad6c00640 1 -- 172.21.15.46:0/1114264027 wait complete. 2024-08-17T02:31:09.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.092+0000 7fdad6c00640 1 Processor -- start 2024-08-17T02:31:09.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.092+0000 7fdad6c00640 1 -- start start 2024-08-17T02:31:09.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad0156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0169360 con 0x7fdad0158ea0 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0169640 con 0x7fdad0158ad0 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6c00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0169920 con 0x7fdad00ac5b0 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51984/0 (socket says 172.21.15.46:51984) 2024-08-17T02:31:09.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 -- 172.21.15.46:0/2810628791 learned_addr learned my addr 172.21.15.46:0/2810628791 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad5800640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad4e00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad0156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 -- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 msgr2=0x7fdad00ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 -- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 msgr2=0x7fdad0156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad0156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.093+0000 7fdad6200640 1 -- 172.21.15.46:0/2810628791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009450 con 0x7fdad0158ea0 2024-08-17T02:31:09.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdad6200640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009e90 tx=0x7fdac800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800ce10 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800f040 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac80146d0 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad0169c00 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.094+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad00cb050 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.095+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad0071050 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.096+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdac8014a80 con 0x7fdad0158ea0 2024-08-17T02:31:09.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.097+0000 7fdaccc00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 0x7fdab0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.097+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fdac8082e40 con 0x7fdad0158ea0 2024-08-17T02:31:09.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.097+0000 7fdad5800640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 0x7fdab0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.098+0000 7fdad5800640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 0x7fdab0067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdac4034000 tx=0x7fdac4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.101+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdac8054b90 con 0x7fdad0158ea0 2024-08-17T02:31:09.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.279+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdad01694a0 con 0x7fdab0065150 2024-08-17T02:31:09.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.281+0000 7fdaccc00640 1 -- 172.21.15.46:0/2810628791 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50337 (secure 0 0 0) 0x7fdad01694a0 con 0x7fdab0065150 2024-08-17T02:31:09.282 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:09.282 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:31:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.283+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 msgr2=0x7fdab0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.283+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 0x7fdab0067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdac4034000 tx=0x7fdac4032000 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.283+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 msgr2=0x7fdad00aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.283+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009e90 tx=0x7fdac800b040 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 shutdown_connections 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdad0158ea0 0x7fdad00aa730 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdad0158ad0 0x7fdad0156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7fdab0065150 0x7fdab0067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 --2- 172.21.15.46:0/2810628791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdad00ac5b0 0x7fdad00ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 >> 172.21.15.46:0/2810628791 conn(0x7fdad0096a70 msgr2=0x7fdad00ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 shutdown_connections 2024-08-17T02:31:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:09.284+0000 7fdad6c00640 1 -- 172.21.15.46:0/2810628791 wait complete. 2024-08-17T02:31:09.299 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:31:09.067803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400584,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574136,"statfs":{"total":773094113280,"available":770635915264,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.462086"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:30:57.601702+0000","last_change":"2024-08-17T02:27:35.234343+0000","last_active":"2024-08-17T02:30:57.601702+0000","last_peered":"2024-08-17T02:30:57.601702+0000","last_clean":"2024-08-17T02:30:57.601702+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:30:57.601702+0000","last_undegraded":"2024-08-17T02:30:57.601702+0000","last_fullsized":"2024-08-17T02:30:57.601702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:33.776415+0000","last_clean_scrub_stamp":"2024-08-17T02:27:33.776415+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:09:25.406233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298428,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073412,"statfs":{"total":96636764160,"available":96331173888,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63500000000000001,"15min":0.59699999999999998},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63300000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.65400000000000003},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.60699999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.64500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84499999999999997,"5min":1.264,"15min":1.264},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.625},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.52900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71999999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.71,"15min":1.71},"last":0.754},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89100000000000001,"5min":1.375,"15min":1.375},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.89200000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.86899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84299999999999997,"5min":1.361,"15min":1.361},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.79300000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1899999999999999,"5min":1.262,"15min":1.262},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.63900000000000001},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.56399999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65700000000000003,"15min":0.61399999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.65000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.55000000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.254,"15min":1.254},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.63200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":1.04,"15min":1.04},"last":0.502},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1319999999999999,"5min":1.208,"15min":1.208},"last":0.56200000000000006}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.67400000000000004,"5min":0.998,"15min":0.998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78200000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.42999999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":1.27,"15min":1.27},"last":0.44},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73999999999999999,"15min":0.76500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.468,"15min":1.468},"last":0.41299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89100000000000001,"5min":1.194,"15min":1.194},"last":0.47499999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.746,"15min":0.72199999999999998},"min":{"1min":0.71199999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.94499999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.68300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.626},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.137,"15min":1.137},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.59899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91600000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98199999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.052,"15min":1.052},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.748,"5min":1.161,"15min":1.161},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.016,"15min":1.016},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89800000000000002,"5min":1.264,"15min":1.264},"last":0.79200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67500000000000004,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.321,"15min":1.321},"last":0.63900000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":1.742,"15min":1.742},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.754},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.248,"15min":1.248},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.78300000000000003},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0229999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.97199999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80600000000000005,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":2.327,"15min":2.327},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.036,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.997}]},{"osd":6,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.99199999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.81899999999999995},"min":{"1min":0.65700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.03,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.014}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.0780000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.321,"15min":1.321},"last":0.93999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74299999999999999,"5min":1.109,"15min":1.109},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.45100000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51700000000000002,"15min":0.48699999999999999},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.505},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58699999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76700000000000002,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98599999999999999,"5min":1.165,"15min":1.165},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.069,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.117}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.64600000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.075},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0569999999999999,"5min":1.343,"15min":1.343},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.66300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0940000000000001,"5min":1.246,"15min":1.246},"last":1.034},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.78900000000000003},"min":{"1min":0.627,"5min":0.504,"15min":0.504},"max":{"1min":1.0049999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":1.054}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.23,"15min":1.23},"last":1.0980000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":1.079,"15min":1.079},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61199999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.439},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.749,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.66900000000000004},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.66100000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77700000000000002,"15min":0.755},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.623},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.504}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0109999999999999,"5min":1.103,"15min":1.103},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0029999999999999,"5min":1.149,"15min":1.149},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84999999999999998,"5min":1.992,"15min":1.992},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64100000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.41999999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58699999999999997,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66900000000000004,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90400000000000003,"5min":1.843,"15min":1.843},"last":0.60599999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":1.962,"15min":1.962},"last":0.70499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0960000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0589999999999999,"5min":2.056,"15min":2.056},"last":0.58499999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.84499999999999997},"min":{"1min":0.64300000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.911,"15min":1.911},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.879},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92000000000000004,"5min":1.587,"15min":1.587},"last":0.53300000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85699999999999998,"15min":0.89000000000000001},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97799999999999998,"5min":1.72,"15min":1.72},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.873,"15min":0.90800000000000003},"min":{"1min":0.621,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:09.302 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:27:33.776415+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=33, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=31, tm_sec=3, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:31:09.302 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:31:14.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:14.197 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:29.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:29.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.468+0000 7f84f1400640 1 Processor -- start 2024-08-17T02:31:29.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.468+0000 7f84f1400640 1 -- start start 2024-08-17T02:31:29.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84f1400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84ec1401b0 0x7f84ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84f1400640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0caa80 con 0x7f84ec0b1440 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84f1400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0c9e70 con 0x7f84ec140580 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84f1400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0cb450 con 0x7f84ec1401b0 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84eb200640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f84ec0b1440 0x7f84ec0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:59344/0 (socket says 172.21.15.46:59344) 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84eb200640 1 -- 172.21.15.46:0/1371706607 learned_addr learned my addr 172.21.15.46:0/1371706607 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:29.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84ea800640 1 --2- 172.21.15.46:0/1371706607 >> v2:172.21.15.162:3300/0 conn(0x7f84ec1401b0 0x7f84ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84e9e00640 1 -- 172.21.15.46:0/1371706607 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477862770 0 0) 0x7f84ec0caa80 con 0x7f84ec0b1440 2024-08-17T02:31:29.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.470+0000 7f84e9e00640 1 -- 172.21.15.46:0/1371706607 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d00034e0 con 0x7f84ec0b1440 2024-08-17T02:31:29.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.471+0000 7f84ea800640 1 -- 172.21.15.46:0/1371706607 >> v1:172.21.15.162:6789/0 conn(0x7f84ec140580 legacy=0x7f84ec0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.471+0000 7f84ea800640 1 -- 172.21.15.46:0/1371706607 >> v1:172.21.15.46:6789/0 conn(0x7f84ec0b1440 legacy=0x7f84ec0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.471+0000 7f84ea800640 1 -- 172.21.15.46:0/1371706607 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0ca150 con 0x7f84ec1401b0 2024-08-17T02:31:29.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84ea800640 1 --2- 172.21.15.46:0/1371706607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec1401b0 0x7f84ec0caf10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009850 tx=0x7f84dc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f16b0bdd9021b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84e9e00640 1 -- 172.21.15.46:0/1371706607 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc02ad90 con 0x7f84ec1401b0 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84e9e00640 1 -- 172.21.15.46:0/1371706607 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc032440 con 0x7f84ec1401b0 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84e9e00640 1 -- 172.21.15.46:0/1371706607 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0327c0 con 0x7f84ec1401b0 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84f1400640 1 -- 172.21.15.46:0/1371706607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec1401b0 msgr2=0x7f84ec0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.472+0000 7f84f1400640 1 --2- 172.21.15.46:0/1371706607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec1401b0 0x7f84ec0caf10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009850 tx=0x7f84dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.473+0000 7f84f1400640 1 -- 172.21.15.46:0/1371706607 shutdown_connections 2024-08-17T02:31:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.473+0000 7f84f1400640 1 --2- 172.21.15.46:0/1371706607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec1401b0 0x7f84ec0caf10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.473+0000 7f84f1400640 1 -- 172.21.15.46:0/1371706607 >> 172.21.15.46:0/1371706607 conn(0x7f84ec0cb9b0 msgr2=0x7f84ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.473+0000 7f84f1400640 1 -- 172.21.15.46:0/1371706607 shutdown_connections 2024-08-17T02:31:29.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.473+0000 7f84f1400640 1 -- 172.21.15.46:0/1371706607 wait complete. 2024-08-17T02:31:29.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.474+0000 7f84f1400640 1 Processor -- start 2024-08-17T02:31:29.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.474+0000 7f84f1400640 1 -- start start 2024-08-17T02:31:29.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84ec0b1440 0x7f84ec0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 0x7f84ec15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec15c520 con 0x7f84ec1401b0 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec15c7d0 con 0x7f84ec140580 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84f1400640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec15cab0 con 0x7f84ec0b1440 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84e3e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53746/0 (socket says 172.21.15.46:53746) 2024-08-17T02:31:29.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.475+0000 7f84e3e00640 1 -- 172.21.15.46:0/4194268335 learned_addr learned my addr 172.21.15.46:0/4194268335 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84eb200640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 0x7f84ec15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84ea800640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84ec0b1440 0x7f84ec0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 -- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84ec0b1440 msgr2=0x7f84ec0ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84ec0b1440 0x7f84ec0ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 -- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 msgr2=0x7f84ec15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 0x7f84ec15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 -- 172.21.15.46:0/4194268335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc009390 con 0x7f84ec1401b0 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84eb200640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 0x7f84ec15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:29.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e3e00640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c560 tx=0x7f84d4007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4011590 con 0x7f84ec1401b0 2024-08-17T02:31:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40116f0 con 0x7f84ec1401b0 2024-08-17T02:31:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4011af0 con 0x7f84ec1401b0 2024-08-17T02:31:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.476+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec15cd90 con 0x7f84ec1401b0 2024-08-17T02:31:29.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.477+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec15d350 con 0x7f84ec1401b0 2024-08-17T02:31:29.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.478+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec064db0 con 0x7f84ec1401b0 2024-08-17T02:31:29.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.478+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f84d401b3b0 con 0x7f84ec1401b0 2024-08-17T02:31:29.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.479+0000 7f84e2000640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 0x7f84c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.479+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f84d40816d0 con 0x7f84ec1401b0 2024-08-17T02:31:29.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.480+0000 7f84ea800640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 0x7f84c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.481+0000 7f84ea800640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 0x7f84c8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84dc034000 tx=0x7f84dc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.483+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84d404f990 con 0x7f84ec1401b0 2024-08-17T02:31:29.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.661+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 --> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84ec06e480 con 0x7f84c8065150 2024-08-17T02:31:29.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.663+0000 7f84e2000640 1 -- 172.21.15.46:0/4194268335 <== mgr.4106 v2:172.21.15.162:6832/37026 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50410 (secure 0 0 0) 0x7f84ec06e480 con 0x7f84c8065150 2024-08-17T02:31:29.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:29.666 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-08-17T02:31:29.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 msgr2=0x7f84c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 0x7f84c8067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84dc034000 tx=0x7f84dc032000 comp rx=0 tx=0).stop 2024-08-17T02:31:29.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 msgr2=0x7f84ec15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c560 tx=0x7f84d4007eb0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 shutdown_connections 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84ec140580 0x7f84ec15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84ec1401b0 0x7f84ec15baa0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7f84c8065150 0x7f84c8067600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 --2- 172.21.15.46:0/4194268335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84ec0b1440 0x7f84ec0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 >> 172.21.15.46:0/4194268335 conn(0x7f84ec0cb9b0 msgr2=0x7f84ec06c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:29.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 shutdown_connections 2024-08-17T02:31:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.666+0000 7f84f1400640 1 -- 172.21.15.46:0/4194268335 wait complete. 2024-08-17T02:31:29.682 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-08-17T02:31:29.072367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400568,"kb_used_data":5064,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574152,"statfs":{"total":773094113280,"available":770635931648,"internally_reserved":0,"allocated":5185536,"data_stored":2826128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002503"},"pg_stats":[{"pgid":"1.0","version":"42'119","reported_seq":194,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:31:17.331915+0000","last_change":"2024-08-17T02:31:17.331882+0000","last_active":"2024-08-17T02:31:17.331915+0000","last_peered":"2024-08-17T02:31:17.331915+0000","last_clean":"2024-08-17T02:31:17.331915+0000","last_became_active":"2024-08-17T02:27:35.233378+0000","last_became_peered":"2024-08-17T02:27:35.233378+0000","last_unstale":"2024-08-17T02:31:17.331915+0000","last_undegraded":"2024-08-17T02:31:17.331915+0000","last_fullsized":"2024-08-17T02:31:17.331915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'119","last_scrub_stamp":"2024-08-17T02:31:17.331784+0000","last_deep_scrub":"42'119","last_deep_scrub_stamp":"2024-08-17T02:31:17.331784+0000","last_clean_scrub_stamp":"2024-08-17T02:31:17.331784+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:09:34.737668+0000","scrub_duration":0.005393264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63500000000000001,"15min":0.59699999999999998},"min":{"1min":0.53400000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69499999999999995,"15min":0.67300000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.89300000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68200000000000005,"15min":0.65400000000000003},"min":{"1min":0.56999999999999995,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89900000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.60699999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.70899999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.84499999999999997,"5min":1.264,"15min":1.264},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67300000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.56599999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.67600000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.621,"15min":0.65200000000000002},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72999999999999998,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.625,"15min":0.63400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.77700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.68899999999999995,"15min":0.72699999999999998},"min":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.72799999999999998,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86799999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Aug 17 02:30:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.504,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.52900000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85499999999999998,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75,"15min":0.75900000000000001},"min":{"1min":0.503,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":0.84899999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71999999999999997,"15min":0.71199999999999997},"min":{"1min":0.53400000000000003,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97699999999999998,"5min":1.71,"15min":1.71},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78100000000000003},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.629,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93300000000000005,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.72299999999999998,"15min":0.71999999999999997},"min":{"1min":0.52000000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.89100000000000001,"5min":1.375,"15min":1.375},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75900000000000001,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72299999999999998,"15min":0.70899999999999996},"min":{"1min":0.65200000000000002,"5min":0.503,"15min":0.503},"max":{"1min":0.89200000000000002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.878}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.84299999999999997,"5min":1.361,"15min":1.361},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.72399999999999998},"min":{"1min":0.47499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.628}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68899999999999995,"15min":0.71999999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.76800000000000002,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89000000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79000000000000004},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1899999999999999,"5min":1.262,"15min":1.262},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.67800000000000005,"15min":0.63900000000000001},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.56399999999999995,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.65700000000000003,"15min":0.61399999999999999},"min":{"1min":0.60299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.65000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.63400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.254,"15min":1.254},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.63200000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.59399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.999,"5min":1.04,"15min":1.04},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.61499999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1319999999999999,"5min":1.208,"15min":1.208},"last":0.70899999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.67400000000000004,"5min":0.998,"15min":0.998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69599999999999995,"15min":0.70599999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.87,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78200000000000003,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67400000000000004,"15min":0.69599999999999995},"min":{"1min":0.497,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72999999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.69199999999999995,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72699999999999998,"5min":1.27,"15min":1.27},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.73999999999999999,"15min":0.76500000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88800000000000001,"5min":1.468,"15min":1.468},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297848,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073992,"statfs":{"total":96636764160,"available":96331767808,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94999999999999996,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.57699999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.89100000000000001,"5min":1.194,"15min":1.194},"last":0.79000000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.746,"15min":0.72199999999999998},"min":{"1min":0.71199999999999997,"5min":0.496,"15min":0.496},"max":{"1min":0.94499999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.76100000000000001,"15min":0.745},"min":{"1min":0.68300000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99299999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80700000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.53800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96199999999999997,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.58299999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96599999999999997,"5min":1.137,"15min":1.137},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.59899999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91600000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78100000000000003,"15min":0.78600000000000003},"min":{"1min":0.63,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.98199999999999998,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65300000000000002,"15min":0.67900000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.77800000000000002,"5min":1.052,"15min":1.052},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.68100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.873,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68200000000000005,"15min":0.71499999999999997},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.748,"5min":1.161,"15min":1.161},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71299999999999997,"15min":0.73599999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":1.016,"15min":1.016},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69799999999999995,"15min":0.71599999999999997},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93200000000000005,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.80000000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89800000000000002,"5min":1.264,"15min":1.264},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70899999999999996,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.435,"15min":0.42499999999999999},"min":{"1min":0.34599999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.505}]},{"osd":1,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51400000000000001,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67500000000000004,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.46200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":1.321,"15min":1.321},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51100000000000001,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":1.742,"15min":1.742},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.754},"min":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0620000000000001,"5min":1.248,"15min":1.248},"last":0.996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.78300000000000003},"min":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0229999999999999,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.0289999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80600000000000005,"15min":0.78900000000000003},"min":{"1min":0.60899999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":2.327,"15min":2.327},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.036,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.0069999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.79200000000000004,"15min":0.77400000000000002},"min":{"1min":0.625,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.99199999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.052},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82699999999999996,"15min":0.81899999999999995},"min":{"1min":0.65700000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.03,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84399999999999997,"15min":0.84599999999999997},"min":{"1min":0.64300000000000002,"5min":0.624,"15min":0.624},"max":{"1min":1.0780000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.80300000000000005,"15min":0.78100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.321,"15min":1.321},"last":0.84399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.32000000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.74299999999999999,"5min":1.109,"15min":1.109},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47899999999999998,"15min":0.45100000000000001},"min":{"1min":0.38900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.47399999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.51700000000000002,"15min":0.48699999999999999},"min":{"1min":0.378,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.47199999999999998},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73999999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.61299999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.76700000000000002,"15min":0.749},"min":{"1min":0.60699999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98599999999999999,"5min":1.165,"15min":1.165},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.57899999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.069,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.79500000000000004,"15min":0.77900000000000003},"min":{"1min":0.64600000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0569999999999999,"5min":1.343,"15min":1.343},"last":0.80300000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78400000000000003,"15min":0.77100000000000002},"min":{"1min":0.66300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0940000000000001,"5min":1.246,"15min":1.246},"last":0.755},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.78900000000000003},"min":{"1min":0.627,"5min":0.504,"15min":0.504},"max":{"1min":1.0049999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81299999999999994,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.081,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.65500000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.044,"5min":1.23,"15min":1.23},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302008,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":499712,"data_stored":205674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71199999999999997,"5min":1.079,"15min":1.079},"last":0.433},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.61199999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.432,"15min":0.42199999999999999},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59299999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.46500000000000002},"min":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.51400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.749,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.625,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0049999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.66900000000000004},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.751,"15min":0.72799999999999998},"min":{"1min":0.66100000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.77700000000000002,"15min":0.755},"min":{"1min":0.63300000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96199999999999997,"5min":1.091,"15min":1.091},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76300000000000001,"15min":0.749},"min":{"1min":0.629,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.76800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0109999999999999,"5min":1.103,"15min":1.103},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.67600000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0029999999999999,"5min":1.149,"15min":1.149},"last":0.95399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302580,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069260,"statfs":{"total":96636764160,"available":96326922240,"internally_reserved":0,"allocated":1093632,"data_stored":796042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.63800000000000001},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84999999999999998,"5min":1.992,"15min":1.992},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35499999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64100000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.58699999999999997,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66900000000000004,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.442},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.63100000000000001},"min":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90400000000000003,"5min":1.843,"15min":1.843},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79800000000000004,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94599999999999995,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.625,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.131,"5min":1.962,"15min":1.962},"last":0.78000000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82199999999999995,"15min":0.84799999999999998},"min":{"1min":0.59599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0960000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0589999999999999,"5min":2.056,"15min":2.056},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.84499999999999997},"min":{"1min":0.64300000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.911,"15min":1.911},"last":0.748},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84199999999999997,"15min":0.879},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92000000000000004,"5min":1.587,"15min":1.587},"last":0.60799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.85699999999999998,"15min":0.89000000000000001},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97799999999999998,"5min":1.72,"15min":1.72},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.873,"15min":0.90800000000000003},"min":{"1min":0.621,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.94999999999999996,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:29.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:31:29.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.830+0000 7ffa7ae00640 1 Processor -- start 2024-08-17T02:31:29.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.830+0000 7ffa7ae00640 1 -- start start 2024-08-17T02:31:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa7ae00640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ffa7415b4d0 0x7ffa74068140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa7ae00640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415c7b0 con 0x7ffa740ae8e0 2024-08-17T02:31:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa7ae00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415a030 con 0x7ffa7415c3e0 2024-08-17T02:31:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa7ae00640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa74159700 con 0x7ffa7415b4d0 2024-08-17T02:31:29.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa73400640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffa740ae8e0 0x7ffa74067a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55352/0 (socket says 172.21.15.46:55352) 2024-08-17T02:31:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa73400640 1 -- 172.21.15.46:0/3433448724 learned_addr learned my addr 172.21.15.46:0/3433448724 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:29.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.831+0000 7ffa78e00640 1 --2- 172.21.15.46:0/3433448724 >> v2:172.21.15.46:3300/0 conn(0x7ffa7415b4d0 0x7ffa74068140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.832+0000 7ffa72a00640 1 -- 172.21.15.46:0/3433448724 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602331966 0 0) 0x7ffa60001110 con 0x7ffa740ae8e0 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.832+0000 7ffa78e00640 1 -- 172.21.15.46:0/3433448724 >> v1:172.21.15.162:6789/0 conn(0x7ffa7415c3e0 legacy=0x7ffa740ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.832+0000 7ffa78e00640 1 -- 172.21.15.46:0/3433448724 >> v1:172.21.15.46:6789/0 conn(0x7ffa740ae8e0 legacy=0x7ffa74067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.832+0000 7ffa78e00640 1 -- 172.21.15.46:0/3433448724 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa741599e0 con 0x7ffa7415b4d0 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.833+0000 7ffa78e00640 1 --2- 172.21.15.46:0/3433448724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7415b4d0 0x7ffa74068140 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009e60 tx=0x7ffa6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f12a443e57b0f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.833+0000 7ffa72a00640 1 -- 172.21.15.46:0/3433448724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c007550 con 0x7ffa7415b4d0 2024-08-17T02:31:29.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.833+0000 7ffa72a00640 1 -- 172.21.15.46:0/3433448724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c02d050 con 0x7ffa7415b4d0 2024-08-17T02:31:29.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.833+0000 7ffa72a00640 1 -- 172.21.15.46:0/3433448724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0078e0 con 0x7ffa7415b4d0 2024-08-17T02:31:29.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 -- 172.21.15.46:0/3433448724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7415b4d0 msgr2=0x7ffa74068140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/3433448724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7415b4d0 0x7ffa74068140 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009e60 tx=0x7ffa6c009780 comp rx=0 tx=0).stop 2024-08-17T02:31:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 -- 172.21.15.46:0/3433448724 shutdown_connections 2024-08-17T02:31:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/3433448724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa7415b4d0 0x7ffa74068140 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 -- 172.21.15.46:0/3433448724 >> 172.21.15.46:0/3433448724 conn(0x7ffa740b17a0 msgr2=0x7ffa740b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 -- 172.21.15.46:0/3433448724 shutdown_connections 2024-08-17T02:31:29.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.834+0000 7ffa7ae00640 1 -- 172.21.15.46:0/3433448724 wait complete. 2024-08-17T02:31:29.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.835+0000 7ffa7ae00640 1 Processor -- start 2024-08-17T02:31:29.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.835+0000 7ffa7ae00640 1 -- start start 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7415b4d0 0x7ffa740980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa7415c3e0 0x7ffa7414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa74098a90 con 0x7ffa740ae8e0 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c5510 con 0x7ffa7415b4d0 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa7ae00640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c57f0 con 0x7ffa7415c3e0 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa73e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa73e00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59186/0 (socket says 172.21.15.46:59186) 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.836+0000 7ffa73e00640 1 -- 172.21.15.46:0/49555662 learned_addr learned my addr 172.21.15.46:0/49555662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73400640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7415b4d0 0x7ffa740980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa78e00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa7415c3e0 0x7ffa7414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 -- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa7415c3e0 msgr2=0x7ffa7414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa7415c3e0 0x7ffa7414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 -- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7415b4d0 msgr2=0x7ffa740980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7415b4d0 0x7ffa740980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:29.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 -- 172.21.15.46:0/49555662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009a20 con 0x7ffa740ae8e0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa73e00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c4c0 tx=0x7ffa64007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011590 con 0x7ffa740ae8e0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64011710 con 0x7ffa740ae8e0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.837+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740c5ad0 con 0x7ffa740ae8e0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.838+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011ad0 con 0x7ffa740ae8e0 2024-08-17T02:31:29.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.838+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa74097300 con 0x7ffa740ae8e0 2024-08-17T02:31:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.839+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa74071050 con 0x7ffa740ae8e0 2024-08-17T02:31:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.839+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa6401b3b0 con 0x7ffa740ae8e0 2024-08-17T02:31:29.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.840+0000 7ffa6b400640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 0x7ffa54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:29.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.840+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffa64081720 con 0x7ffa740ae8e0 2024-08-17T02:31:29.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.841+0000 7ffa73400640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 0x7ffa54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:29.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.841+0000 7ffa73400640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 0x7ffa54067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa7416daf0 tx=0x7ffa60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:29.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:29.844+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa6404f9e0 con 0x7ffa740ae8e0 2024-08-17T02:31:30.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.030+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ffa740a9320 con 0x7ffa740ae8e0 2024-08-17T02:31:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.034+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffa6404f9e0 con 0x7ffa740ae8e0 2024-08-17T02:31:30.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.035+0000 7ffa6b400640 1 -- 172.21.15.46:0/49555662 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ffa64017020 con 0x7ffa740ae8e0 2024-08-17T02:31:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 msgr2=0x7ffa54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 0x7ffa54067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa7416daf0 tx=0x7ffa60009040 comp rx=0 tx=0).stop 2024-08-17T02:31:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 msgr2=0x7ffa740c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c4c0 tx=0x7ffa64007ef0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 shutdown_connections 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ffa54065150 0x7ffa54067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa7415c3e0 0x7ffa7414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7415b4d0 0x7ffa740980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 --2- 172.21.15.46:0/49555662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa740ae8e0 0x7ffa740c7cf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 >> 172.21.15.46:0/49555662 conn(0x7ffa740b17a0 msgr2=0x7ffa74158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 shutdown_connections 2024-08-17T02:31:30.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.038+0000 7ffa7ae00640 1 -- 172.21.15.46:0/49555662 wait complete. 2024-08-17T02:31:30.053 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:31:30.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.205+0000 7ff217200640 1 Processor -- start 2024-08-17T02:31:30.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.205+0000 7ff217200640 1 -- start start 2024-08-17T02:31:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.206+0000 7ff217200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff210155df0 0x7ff2100adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:30.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.206+0000 7ff217200640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210156670 con 0x7ff210155a20 2024-08-17T02:31:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.206+0000 7ff217200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21006e5e0 con 0x7ff21006df00 2024-08-17T02:31:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.206+0000 7ff217200640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100b0350 con 0x7ff210155df0 2024-08-17T02:31:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff215200640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff210155df0 0x7ff2100adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff20fe00640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff210155a20 0x7ff21006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:55360/0 (socket says 172.21.15.46:55360) 2024-08-17T02:31:30.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff20fe00640 1 -- 172.21.15.46:0/1406859754 learned_addr learned my addr 172.21.15.46:0/1406859754 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-08-17T02:31:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff215200640 1 -- 172.21.15.46:0/1406859754 >> v1:172.21.15.162:6789/0 conn(0x7ff21006df00 legacy=0x7ff210156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff215200640 1 -- 172.21.15.46:0/1406859754 >> v1:172.21.15.46:6789/0 conn(0x7ff210155a20 legacy=0x7ff21006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff215200640 1 -- 172.21.15.46:0/1406859754 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21006e8c0 con 0x7ff210155df0 2024-08-17T02:31:30.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.207+0000 7ff20f400640 1 -- 172.21.15.46:0/1406859754 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104522107 0 0) 0x7ff210156670 con 0x7ff210155a20 2024-08-17T02:31:30.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.208+0000 7ff215200640 1 --2- 172.21.15.46:0/1406859754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff2100adf10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff208009e60 tx=0x7ff208009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ced3974c0f9da25 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:30.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.208+0000 7ff20f400640 1 -- 172.21.15.46:0/1406859754 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007550 con 0x7ff210155df0 2024-08-17T02:31:30.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.208+0000 7ff20f400640 1 -- 172.21.15.46:0/1406859754 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff20802d050 con 0x7ff210155df0 2024-08-17T02:31:30.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.208+0000 7ff20f400640 1 -- 172.21.15.46:0/1406859754 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007900 con 0x7ff210155df0 2024-08-17T02:31:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 -- 172.21.15.46:0/1406859754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 msgr2=0x7ff2100adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 --2- 172.21.15.46:0/1406859754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff2100adf10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff208009e60 tx=0x7ff208009780 comp rx=0 tx=0).stop 2024-08-17T02:31:30.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 -- 172.21.15.46:0/1406859754 shutdown_connections 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 --2- 172.21.15.46:0/1406859754 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff2100adf10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 -- 172.21.15.46:0/1406859754 >> 172.21.15.46:0/1406859754 conn(0x7ff2100cb9b0 msgr2=0x7ff2100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 -- 172.21.15.46:0/1406859754 shutdown_connections 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.209+0000 7ff217200640 1 -- 172.21.15.46:0/1406859754 wait complete. 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.210+0000 7ff217200640 1 Processor -- start 2024-08-17T02:31:30.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.211+0000 7ff217200640 1 -- start start 2024-08-17T02:31:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.211+0000 7ff217200640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff21006df00 0x7ff21014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.211+0000 7ff217200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210155a20 0x7ff21014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.211+0000 7ff217200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff217200640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21014f8a0 con 0x7ff210155df0 2024-08-17T02:31:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff217200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21014ecd0 con 0x7ff210155a20 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff217200640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21014ef70 con 0x7ff21006df00 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59206/0 (socket says 172.21.15.46:59206) 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 -- 172.21.15.46:0/3087177879 learned_addr learned my addr 172.21.15.46:0/3087177879 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff207e00640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210155a20 0x7ff21014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff20fe00640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff21006df00 0x7ff21014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 -- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff21006df00 msgr2=0x7ff21014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff21006df00 0x7ff21014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 -- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210155a20 msgr2=0x7ff21014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210155a20 0x7ff21014a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.212+0000 7ff215200640 1 -- 172.21.15.46:0/3087177879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009a20 con 0x7ff210155df0 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff215200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff2080099f0 tx=0x7ff208009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208031b70 con 0x7ff210155df0 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff208031cd0 con 0x7ff210155df0 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20803c670 con 0x7ff210155df0 2024-08-17T02:31:30.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21014f250 con 0x7ff210155df0 2024-08-17T02:31:30.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.213+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21014a790 con 0x7ff210155df0 2024-08-17T02:31:30.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.214+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21014fa10 con 0x7ff210155df0 2024-08-17T02:31:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.215+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff20803ca60 con 0x7ff210155df0 2024-08-17T02:31:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.216+0000 7ff207400640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.216+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff2080a37a0 con 0x7ff210155df0 2024-08-17T02:31:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.216+0000 7ff20fe00640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.217+0000 7ff20fe00640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 0x7ff1ec067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff2000011e0 tx=0x7ff200007c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:30.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.220+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff208071b90 con 0x7ff210155df0 2024-08-17T02:31:30.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.446+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff210064db0 con 0x7ff210155df0 2024-08-17T02:31:30.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.446+0000 7ff207400640 1 -- 172.21.15.46:0/3087177879 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ff208049de0 con 0x7ff210155df0 2024-08-17T02:31:30.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-08-17T02:31:30.448 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4879,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1293288118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1293288118},{"type":"v1","addr":"172.21.15.162:6836","nonce":1293288118}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4882,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3794123758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3794123758},{"type":"v1","addr":"172.21.15.162:6837","nonce":3794123758}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/2491802042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":2491802042},{"type":"v1","addr":"172.21.15.46:6835","nonce":2491802042}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5370,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/1317829978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":1317829978},{"type":"v1","addr":"172.21.15.46:6833","nonce":1317829978}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2024-08-17T02:31:30.448 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-08-17T02:31:30.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 msgr2=0x7ff1ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 0x7ff1ec067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff2000011e0 tx=0x7ff200007c80 comp rx=0 tx=0).stop 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 msgr2=0x7ff21013bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff2080099f0 tx=0x7ff208009780 comp rx=0 tx=0).stop 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 shutdown_connections 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff210155df0 0x7ff21013bf40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210155a20 0x7ff21014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:6832/37026,v1:172.21.15.162:6833/37026] conn(0x7ff1ec065150 0x7ff1ec067600 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 --2- 172.21.15.46:0/3087177879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff21006df00 0x7ff21014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 >> 172.21.15.46:0/3087177879 conn(0x7ff2100cb9b0 msgr2=0x7ff210154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.448+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 shutdown_connections 2024-08-17T02:31:30.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-08-17T02:31:30.449+0000 7ff217200640 1 -- 172.21.15.46:0/3087177879 wait complete. 2024-08-17T02:31:30.464 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:31:30.464 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:31:30.465 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:31:30.465 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.478 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:31:30.478 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:31:30.478 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.532 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:31:30.533 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:31:30.533 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.549 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:31:30.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:31:30.550 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.606 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:31:30.606 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:31:30.606 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:31:30.606 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.646 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:31:30.646 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:31:30.646 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.725 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:31:30.725 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:31:30.726 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.812 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:31:30.812 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:31:30.812 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.852 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:31:30.852 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:31:30.852 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.890 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:31:30.891 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:31:30.891 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:30.983 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:31:30.983 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:31:30.983 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.040 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:31:31.040 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:31:31.040 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.094 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:31:31.095 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:31:31.095 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:31:31.095 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.152 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:31:31.152 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:31:31.152 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.219 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:31:31.220 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:31:31.220 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:31:31.220 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.239 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:31:31.239 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:31:31.239 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.257 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:31:31.257 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:31:31.257 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:31.316 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:31:31.316 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:31:31.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:31:31.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:31:31.394 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:31:31.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:31:31.626 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:31:31.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:31:31.739 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:31:31.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:31:31.838 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:31:31.946 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:31:31.946 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:31:32.192 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:31:32.193 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:31:32.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:31:32.289 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:31:32.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:31:32.391 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:31:32.501 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:31:32.502 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/data/mon.a.tgz 2024-08-17T02:31:32.502 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-08-17T02:31:32.539 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.KLJ2nLzRRZ 2024-08-17T02:31:32.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KLJ2nLzRRZ 2024-08-17T02:31:32.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.KLJ2nLzRRZ 2024-08-17T02:31:32.808 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.KLJ2nLzRRZ is 304KB 2024-08-17T02:31:32.901 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.KLJ2nLzRRZ 2024-08-17T02:31:32.936 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/data/mon.b.tgz 2024-08-17T02:31:32.936 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-17T02:31:32.973 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.5DGy5dMcmN 2024-08-17T02:31:32.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5DGy5dMcmN 2024-08-17T02:31:33.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.5DGy5dMcmN 2024-08-17T02:31:33.258 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.5DGy5dMcmN is 405KB 2024-08-17T02:31:33.347 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.5DGy5dMcmN 2024-08-17T02:31:33.382 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/data/mon.c.tgz 2024-08-17T02:31:33.382 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-08-17T02:31:33.457 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.dPdlQszBwW 2024-08-17T02:31:33.458 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dPdlQszBwW 2024-08-17T02:31:33.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.dPdlQszBwW 2024-08-17T02:31:33.733 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.dPdlQszBwW is 405KB 2024-08-17T02:31:33.822 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.dPdlQszBwW 2024-08-17T02:31:33.857 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:31:33.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:33.869 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:33.957 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:31:33.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:33.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:34.024 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:34.025 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:34.036 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:31:34.038 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi046/crash 2024-08-17T02:31:34.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:34.095 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi162/crash 2024-08-17T02:31:34.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:34.150 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:31:34.151 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:34.155 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:34.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:34.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:34.354 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:31:34.355 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:34.359 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:34.409 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2024-08-17T02:31:34.410 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43797.log 2024-08-17T02:31:34.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42033.log 2024-08-17T02:31:34.411 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2024-08-17T02:31:34.411 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2024-08-17T02:31:34.412 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43797.log.gz 2024-08-17T02:31:34.413 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37559.log 2024-08-17T02:31:34.413 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42033.log.gz 2024-08-17T02:31:34.415 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42299.log 2024-08-17T02:31:34.415 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:34.415 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.42299.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:34.415 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42299.log.gz 2024-08-17T02:31:34.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43587.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31223.log 2024-08-17T02:31:34.417 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2024-08-17T02:31:34.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2024-08-17T02:31:34.417 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37559.log.gz 2024-08-17T02:31:34.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.31223.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31223.log.gz 2024-08-17T02:31:34.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41296.log 2024-08-17T02:31:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48106.log 2024-08-17T02:31:34.418 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2024-08-17T02:31:34.426 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42620.log 2024-08-17T02:31:34.426 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.42620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42620.log.gz 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.7.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37256.log 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:31:34.427 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37256.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.37347.log -- replaced with /var/log/ceph/ceph-client.admin.37256.log.gz 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37347.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.37347.log.gz -- 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr: /var/log/ceph/ceph-client.admin.37307.log 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37307.log.gz 2024-08-17T02:31:34.428 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:31:34.429 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37427.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:31:34.429 INFO:teuthology.orchestra.run.smithi162.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-08-17T02:31:34.429 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2024-08-17T02:31:34.436 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:31:34.436 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37507.log 2024-08-17T02:31:34.436 INFO:teuthology.orchestra.run.smithi162.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2024-08-17T02:31:34.436 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37467.log 2024-08-17T02:31:34.436 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37507.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37507.log.gz 2024-08-17T02:31:34.437 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37467.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37467.log.gz 2024-08-17T02:31:34.437 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43016.log 2024-08-17T02:31:34.437 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-08-17T02:31:34.437 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.43016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43016.log.gz 2024-08-17T02:31:34.440 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37216.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-08-17T02:31:34.440 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:31:34.440 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49324.log 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41296.log.gz 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48106.log.gz 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2024-08-17T02:31:34.443 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49324.log.gz 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41593.log 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41593.log.gz 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48988.log 2024-08-17T02:31:34.444 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gz 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48988.log.gz 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45772.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:34.445 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45302.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48022.log 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-08-17T02:31:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41973.log 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43671.log 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48022.log.gz 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50341.log 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41973.log.gz 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2024-08-17T02:31:34.447 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43671.log.gz 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41889.log 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50341.log.gz 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50551.log 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41889.log.gz 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:31:34.448 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50551.log.gz 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2024-08-17T02:31:34.449 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48717.log 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49282.log 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48717.log.gz 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-08-17T02:31:34.450 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49282.log.gz 2024-08-17T02:31:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47968.log 2024-08-17T02:31:34.451 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-08-17T02:31:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2024-08-17T02:31:34.457 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-08-17T02:31:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-08-17T02:31:34.457 INFO:teuthology.orchestra.run.smithi046.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47968.log.gz 2024-08-17T02:31:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47448.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49468.log 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2024-08-17T02:31:34.458 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49468.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49468.log.gz 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47280.log 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-08-17T02:31:34.459 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48801.log 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47280.log.gz 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42969.log 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46509.log 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48801.log.gz 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-08-17T02:31:34.460 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42969.log.gz 2024-08-17T02:31:34.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49963.log 2024-08-17T02:31:34.461 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2024-08-17T02:31:34.461 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-08-17T02:31:34.461 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-08-17T02:31:34.462 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:31:34.464 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49963.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:31:34.464 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49963.log.gz 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41637.log 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42957.log 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41637.log.gz 2024-08-17T02:31:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47068.log 2024-08-17T02:31:34.466 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-08-17T02:31:34.466 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-08-17T02:31:34.466 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-08-17T02:31:34.467 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45554.log 2024-08-17T02:31:34.467 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47068.log.gz 2024-08-17T02:31:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42626.log 2024-08-17T02:31:34.468 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-08-17T02:31:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47883.log 2024-08-17T02:31:34.468 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45554.log.gz 2024-08-17T02:31:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2024-08-17T02:31:34.469 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42626.log.gz 2024-08-17T02:31:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47883.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47883.log.gz 2024-08-17T02:31:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:31:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2024-08-17T02:31:34.471 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-08-17T02:31:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46636.log 2024-08-17T02:31:34.472 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2024-08-17T02:31:34.473 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49511.log 2024-08-17T02:31:34.473 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46636.log: /var/log/ceph/ceph-client.admin.41383.log 2024-08-17T02:31:34.474 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46636.log.gz 2024-08-17T02:31:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49511.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:31:34.475 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49511.log.gz 2024-08-17T02:31:34.475 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41383.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:31:34.476 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-08-17T02:31:34.477 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48150.log 2024-08-17T02:31:34.478 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44265.log 2024-08-17T02:31:34.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2024-08-17T02:31:34.480 INFO:teuthology.orchestra.run.smithi046.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.48150.log.gz 2024-08-17T02:31:34.480 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.44265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44265.log.gz 2024-08-17T02:31:34.481 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-08-17T02:31:34.482 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-08-17T02:31:34.482 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2024-08-17T02:31:34.484 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47152.log 2024-08-17T02:31:34.484 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-08-17T02:31:34.484 INFO:teuthology.orchestra.run.smithi046.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:31:34.485 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2024-08-17T02:31:34.485 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-08-17T02:31:34.486 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45512.log 2024-08-17T02:31:34.486 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47152.log.gz 2024-08-17T02:31:34.487 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49595.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:31:34.487 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2024-08-17T02:31:34.489 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42299.log 2024-08-17T02:31:34.489 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45512.log.gz 2024-08-17T02:31:34.489 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:31:34.490 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-08-17T02:31:34.491 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45092.log 2024-08-17T02:31:34.491 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42299.log.gz 2024-08-17T02:31:34.492 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48465.log 2024-08-17T02:31:34.493 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2024-08-17T02:31:34.493 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45092.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45092.log.gz 2024-08-17T02:31:34.494 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48321.log 2024-08-17T02:31:34.495 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2024-08-17T02:31:34.495 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48465.log.gz 2024-08-17T02:31:34.496 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48946.log 2024-08-17T02:31:34.497 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48321.log.gz 2024-08-17T02:31:34.498 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2024-08-17T02:31:34.499 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48946.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48946.log.gz 2024-08-17T02:31:34.499 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-08-17T02:31:34.501 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-08-17T02:31:34.502 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-08-17T02:31:34.502 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gz 2024-08-17T02:31:34.503 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46846.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-08-17T02:31:34.505 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46720.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-08-17T02:31:34.505 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47490.log 2024-08-17T02:31:34.506 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47018.log 2024-08-17T02:31:34.508 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47788.log 2024-08-17T02:31:34.509 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47018.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47490.log.gz 2024-08-17T02:31:34.509 INFO:teuthology.orchestra.run.smithi046.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:31:34.509 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47018.log.gz 2024-08-17T02:31:34.510 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47788.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47788.log.gz 2024-08-17T02:31:34.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-08-17T02:31:34.511 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37674.log 2024-08-17T02:31:34.513 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44714.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.45050.log 2024-08-17T02:31:34.513 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-08-17T02:31:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37674.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37674.log.gz 2024-08-17T02:31:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2024-08-17T02:31:34.519 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41931.log 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45386.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz -5 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43713.log 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41931.log.gz 2024-08-17T02:31:34.520 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43755.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2024-08-17T02:31:34.521 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2024-08-17T02:31:34.521 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2024-08-17T02:31:34.521 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43713.log.gz 2024-08-17T02:31:34.522 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-08-17T02:31:34.522 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2024-08-17T02:31:34.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50173.log 2024-08-17T02:31:34.523 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gz 2024-08-17T02:31:34.523 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41215.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-08-17T02:31:34.524 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:31:34.525 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43545.log 2024-08-17T02:31:34.525 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50173.log.gz 2024-08-17T02:31:34.526 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46126.log 2024-08-17T02:31:34.527 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-08-17T02:31:34.528 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43545.log.gz 2024-08-17T02:31:34.529 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46126.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46126.log.gz 2024-08-17T02:31:34.529 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2024-08-17T02:31:34.530 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-08-17T02:31:34.531 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44840.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-08-17T02:31:34.532 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48591.log 2024-08-17T02:31:34.533 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46930.log 2024-08-17T02:31:34.534 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2024-08-17T02:31:34.534 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48591.log.gz 2024-08-17T02:31:34.536 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46930.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46930.log.gz 2024-08-17T02:31:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46252.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gz 2024-08-17T02:31:34.537 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-08-17T02:31:34.539 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43335.log 2024-08-17T02:31:34.539 INFO:teuthology.orchestra.run.smithi162.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:31:34.540 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50383.log 2024-08-17T02:31:34.540 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-08-17T02:31:34.542 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2024-08-17T02:31:34.542 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43335.log.gz 2024-08-17T02:31:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50383.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50383.log.gz 2024-08-17T02:31:34.543 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2024-08-17T02:31:34.544 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41496.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2024-08-17T02:31:34.545 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50005.log 2024-08-17T02:31:34.546 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43935.log 2024-08-17T02:31:34.546 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2024-08-17T02:31:34.548 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50005.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50005.log.gz 2024-08-17T02:31:34.548 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-client.admin.43935.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47406.log 2024-08-17T02:31:34.549 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43935.log.gz 2024-08-17T02:31:34.549 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-08-17T02:31:34.551 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50215.log 2024-08-17T02:31:34.551 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47406.log.gz 2024-08-17T02:31:34.552 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-08-17T02:31:34.553 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-08-17T02:31:34.553 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50215.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50215.log.gz 2024-08-17T02:31:34.554 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50299.log 2024-08-17T02:31:34.555 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-08-17T02:31:34.555 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-08-17T02:31:34.556 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41847.log 2024-08-17T02:31:34.556 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50299.log.gz 2024-08-17T02:31:34.557 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47364.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2024-08-17T02:31:34.558 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2024-08-17T02:31:34.559 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41847.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41847.log.gz 2024-08-17T02:31:34.559 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2024-08-17T02:31:34.560 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-08-17T02:31:34.561 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2024-08-17T02:31:34.562 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44328.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2024-08-17T02:31:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-08-17T02:31:34.563 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48423.log 2024-08-17T02:31:34.565 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44628.log 2024-08-17T02:31:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gz 2024-08-17T02:31:34.566 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-08-17T02:31:34.567 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.2.44628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44628.log.gz 2024-08-17T02:31:34.568 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49553.log 2024-08-17T02:31:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2024-08-17T02:31:34.569 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-08-17T02:31:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-08-17T02:31:34.570 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49553.log.gz 2024-08-17T02:31:34.572 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49795.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2024-08-17T02:31:34.572 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48675.log 2024-08-17T02:31:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45958.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-08-17T02:31:34.574 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47839.log 2024-08-17T02:31:34.575 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50593.log 2024-08-17T02:31:34.575 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48675.log.gz 2024-08-17T02:31:34.576 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47839.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47839.log.gz 2024-08-17T02:31:34.577 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50593.log: -- /var/log/ceph/ceph-client.admin.46551.log 2024-08-17T02:31:34.577 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50593.log.gz 2024-08-17T02:31:34.578 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41721.log 2024-08-17T02:31:34.580 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2024-08-17T02:31:34.580 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-08-17T02:31:34.581 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41721.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41721.log.gz 2024-08-17T02:31:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49114.log 2024-08-17T02:31:34.582 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41437.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2024-08-17T02:31:34.583 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41805.log 2024-08-17T02:31:34.584 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49637.log 2024-08-17T02:31:34.584 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49114.log.gz 2024-08-17T02:31:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41805.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41805.log.gz 2024-08-17T02:31:34.586 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.49637.log: --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-08-17T02:31:34.587 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49637.log.gz 2024-08-17T02:31:34.587 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49366.log 2024-08-17T02:31:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42297.log 2024-08-17T02:31:34.589 INFO:teuthology.orchestra.run.smithi046.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-08-17T02:31:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49366.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49366.log.gz 2024-08-17T02:31:34.591 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42294.log 2024-08-17T02:31:34.591 INFO:teuthology.orchestra.run.smithi162.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:31:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42297.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42297.log.gz 2024-08-17T02:31:34.592 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48363.log 2024-08-17T02:31:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-08-17T02:31:34.593 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46678.log 2024-08-17T02:31:34.595 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2024-08-17T02:31:34.595 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48363.log.gz 2024-08-17T02:31:34.596 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-08-17T02:31:34.596 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46678.log.gz 2024-08-17T02:31:34.597 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42285.log 2024-08-17T02:31:34.597 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2024-08-17T02:31:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42298.log: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:31:34.599 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-08-17T02:31:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 2024-08-17T02:31:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42285.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42285.log.gz 2024-08-17T02:31:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2024-08-17T02:31:34.601 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:31:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41679.log 2024-08-17T02:31:34.602 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2024-08-17T02:31:34.603 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2024-08-17T02:31:34.603 INFO:teuthology.orchestra.run.smithi046.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2024-08-17T02:31:34.604 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2024-08-17T02:31:34.604 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41679.log.gz 2024-08-17T02:31:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42622.log 2024-08-17T02:31:34.605 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2024-08-17T02:31:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45218.log 2024-08-17T02:31:34.607 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2024-08-17T02:31:34.608 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-08-17T02:31:34.608 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42622.log.gz 2024-08-17T02:31:34.609 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47110.log 2024-08-17T02:31:34.609 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45218.log.gz 2024-08-17T02:31:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2024-08-17T02:31:34.611 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-08-17T02:31:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2024-08-17T02:31:34.612 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47110.log.gz 2024-08-17T02:31:34.613 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48903.log 2024-08-17T02:31:34.613 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2024-08-17T02:31:34.614 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-08-17T02:31:34.614 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2024-08-17T02:31:34.615 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47926.log 2024-08-17T02:31:34.615 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48903.log.gz 2024-08-17T02:31:34.616 INFO:teuthology.orchestra.run.smithi162.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:31:34.617 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:31:34.617 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-08-17T02:31:34.617 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2024-08-17T02:31:34.618 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2024-08-17T02:31:34.618 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47926.log.gz 2024-08-17T02:31:34.619 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2024-08-17T02:31:34.619 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-08-17T02:31:34.620 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2024-08-17T02:31:34.620 INFO:teuthology.orchestra.run.smithi046.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2024-08-17T02:31:34.621 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49837.log 2024-08-17T02:31:34.622 INFO:teuthology.orchestra.run.smithi046.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2024-08-17T02:31:34.623 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-08-17T02:31:34.623 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2024-08-17T02:31:34.624 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47743.log 2024-08-17T02:31:34.624 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49837.log.gz 2024-08-17T02:31:34.625 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-08-17T02:31:34.625 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-08-17T02:31:34.626 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.47743.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42861.log 2024-08-17T02:31:34.626 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.0.47743.log.gz 2024-08-17T02:31:34.627 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45832.log 2024-08-17T02:31:34.628 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-08-17T02:31:34.629 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2024-08-17T02:31:34.629 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42861.log.gz 2024-08-17T02:31:34.630 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-08-17T02:31:34.630 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45832.log.gz 2024-08-17T02:31:34.631 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41119.log 2024-08-17T02:31:34.631 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2024-08-17T02:31:34.633 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46348.log 2024-08-17T02:31:34.633 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-08-17T02:31:34.633 INFO:teuthology.orchestra.run.smithi162.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:31:34.634 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41119.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:31:34.634 INFO:teuthology.orchestra.run.smithi046.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41119.log.gz 2024-08-17T02:31:34.635 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50257.log 2024-08-17T02:31:34.635 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46348.log.gz 2024-08-17T02:31:34.636 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-08-17T02:31:34.637 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-08-17T02:31:34.638 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m0.245s 2024-08-17T02:31:34.638 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m1.061s 2024-08-17T02:31:34.638 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.165s 2024-08-17T02:31:34.638 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-08-17T02:31:34.638 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50257.log.gz 2024-08-17T02:31:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42289.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-08-17T02:31:34.639 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-08-17T02:31:34.640 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48843.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-08-17T02:31:34.640 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2024-08-17T02:31:34.642 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42075.log 2024-08-17T02:31:34.642 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-08-17T02:31:34.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2024-08-17T02:31:34.644 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-08-17T02:31:34.644 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42075.log.gz 2024-08-17T02:31:34.645 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-08-17T02:31:34.646 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49921.log 2024-08-17T02:31:34.647 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-08-17T02:31:34.648 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2024-08-17T02:31:34.648 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-08-17T02:31:34.649 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2024-08-17T02:31:34.649 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49921.log.gz 2024-08-17T02:31:34.650 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2024-08-17T02:31:34.651 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2024-08-17T02:31:34.652 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-08-17T02:31:34.652 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2024-08-17T02:31:34.653 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-08-17T02:31:34.653 INFO:teuthology.orchestra.run.smithi046.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2024-08-17T02:31:34.654 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48633.log 2024-08-17T02:31:34.655 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-08-17T02:31:34.656 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47238.log: 92.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45916.log 2024-08-17T02:31:34.656 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2024-08-17T02:31:34.656 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:31:34.657 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50467.log 2024-08-17T02:31:34.657 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48633.log.gz 2024-08-17T02:31:34.658 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50789.log 2024-08-17T02:31:34.658 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45916.log.gz 2024-08-17T02:31:34.659 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-08-17T02:31:34.659 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50467.log.gz 2024-08-17T02:31:34.661 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2024-08-17T02:31:34.661 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz 2024-08-17T02:31:34.662 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-08-17T02:31:34.662 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-08-17T02:31:34.662 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46888.log 2024-08-17T02:31:34.663 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2024-08-17T02:31:34.664 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-08-17T02:31:34.664 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-08-17T02:31:34.665 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2024-08-17T02:31:34.666 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46888.log.gz 2024-08-17T02:31:34.666 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50131.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-08-17T02:31:34.668 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48549.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2024-08-17T02:31:34.679 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:31:34.696 INFO:teuthology.orchestra.run.smithi046.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:31:34.703 INFO:teuthology.orchestra.run.smithi046.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:31:34.777 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:31:34.780 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-08-17T02:31:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m0.392s 2024-08-17T02:31:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m1.121s 2024-08-17T02:31:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m0.635s 2024-08-17T02:31:34.781 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:31:34.781 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi046/log 2024-08-17T02:31:34.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:35.127 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi162/log 2024-08-17T02:31:35.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:35.323 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:31:35.347 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:31:35.347 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:35.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:35.459 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:31:35.469 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:31:35.469 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:35.474 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:35.503 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:35.508 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -66us[ -41us] +/- 60ms 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -77us[ -52us] +/- 63ms 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +177us[ +202us] +/- 62ms 2024-08-17T02:31:35.511 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:35.514 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:35.514 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-08-17T02:31:35.514 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -56us[ -33us] +/- 60ms 2024-08-17T02:31:35.514 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -65us[ -42us] +/- 63ms 2024-08-17T02:31:35.515 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +185us[ +209us] +/- 62ms 2024-08-17T02:31:35.515 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:35.515 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:31:35.524 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:31:35.525 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:31:35.538 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:35.674 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:35.788 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:35.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:35.848 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:35.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:35.908 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:31:35.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:31:35.933 INFO:teuthology.task.internal:Duration was 737.083097 seconds 2024-08-17T02:31:35.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:31:35.943 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:31:35.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:35.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:36.033 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:36.036 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:36.479 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:31:36.479 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-08-17T02:31:36.479 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:36.530 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-08-17T02:31:36.530 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:36.582 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:31:36.583 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:36.587 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:36.647 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:31:36.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:36.652 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:36.795 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:31:36.806 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:31:36.806 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:36.864 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:36.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:31:36.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:36.936 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:37.003 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-08-17T02:31:37.008 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-08-17T02:31:37.038 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:37.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:37.072 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:37.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:37.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:31:37.115 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:31:37.116 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi046 2024-08-17T02:31:37.116 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:37.180 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858283/remote/smithi162 2024-08-17T02:31:37.180 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:37.244 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:31:37.244 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:37.248 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:37.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:31:37.295 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:31:37.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:31:37.341 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:31:37.341 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:37.346 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:37.376 INFO:teuthology.orchestra.run.smithi046.stdout: 394445 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:37.381 INFO:teuthology.orchestra.run.smithi162.stdout: 394840 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:37.383 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:31:37.394 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:31:37.417 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 737.0830965042114 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5a4b371ffb274b5782327341207f5f8a status: fail success: false 2024-08-17T02:31:37.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:31:37.501 INFO:teuthology.run:FAIL